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ABSTRACT 

The General Accounting Office conducted a 
comprehensive assessment of the degree to which the section 427 
reforms of the Adoption Assistance cad Child Welfare Act of 1980 had 
been carried out, whether they were working, and whether they were 
still needed. A Senate Subcommittee and House Select Committee 
requested the assessment in response to reports that abuses of foster 
care were continuing despite the enactment of reforms in 1980 and 
increased appropriations for child welfare services. An executive 
summary is followed by a six-chapter report on findings. Chapter 1 is 
an introduction. Chapter 2 details foster care protections required 
for child welfare incentive funds. Chapter 3 addresses the issue of 
whether the reforms have been carried out. Chapter 4 reports on the 
effects of the reforms, and Chapter 5 assesses the continuing need 
for federal incentives for reform. Chapter 6 provides conclusions, 
recommendations, and an evaluation of agency comments. Related 
materials, such as the requirements of sections 427 and 425 and 
Health and Human Servicers compliance review components, and the 
outcome of the Administration on Children, Youth, and Families 
reviews of states' compliance with section 427, are provided in eig^** 
appendices. A list of 124 references is included. (RH) 
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Executive Suinmaiy 



^^^POSe During thel970's, widespread abuses of the foster care system were 

reported. The number of children in foster care in 1977 haSr^ied to 
an estimated 50^000 from 318,800 in 1972, and their medi^ eS 
time m care was 31 months. Studies found that many chiiLn in foster 

Tope ofreTurniTt ' '''' hVd ' " 

hope of returning to their parents or of finding another, permanent 

SeTurit Ac 7Zlt 'f^ '''''''' ""der the Social 

becurity Act of 1935, as amended, in light of these reports. 

Concerned about reports that foster care abuses may be continuing 
despite these reforms, the ranking minority member^ of the SenTe 
Labor and Human Resources Subcommittee on Children, FamSy Drugs 

famines asked gao to review a key component of these protections- the 
foster care case plan and review system, gao answered threfq^es ion^ 
(1) Have the case plan and review reforms been carried out '(2) What 
are their effects? and (3) Are reform incentives still needed"^ 



Background Jhe CWld welfare Services grants, authorized by title IV-B of the Social 

Secunty Act, assist the states in providing foste? care-related aid faSv 

S i^^;rh^"'T"^"°" '''' ^^^^^^ « receiveLc" 
lunds— Its full share of annual appropriations for Child Welfare Ser- 
vices exceeding $141 million-unless it has developed and implemented 
18 elements encompassing a system of individual case plans periodic 
reviews, and dispositional hearings for each child in foLr ca^e These 
procedural reforms were designed, as appropriate, to help reunify the 
family or find suitable adoptive homes. (See pages 17 and 18 ) 

deveS^^ " comparative evaluation framework 

developed for the select committee in a previous assignment This 
ramework consists of a standard format for describing a program and 
10 genera cnteria for assessing the implementation, effecte, Sd^omfn- 
ued need for that program, gao reviewed the published literature for 
evidence on indicators of each of the framework's 10 criteria a^d 

ChUdren y 7^"^^'' Admin^stJaUon on 

Children Youth, and Families (acyf) of the Department of Health and 
Human Servi.es (nns), certifies the states' compliance with he require- 
ments and allocates the incentive funds. (See page 16 ) 
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Executive Summary 



T?P<5rlt<5 in Rripf Evidence indicates that the requirements of the 1980 amendments have 

liCbUltb III m lei ^^^^ completely carried out. Although 94 percent of the states had 

met acyf's minimum requirements for the case review system by 1987, 
ACYF compliance reviews revealed problems in completing case reviews 
within the required time periods. Further, even acyf's highest compli- 
ance standard does not require the states to demonstrate full compliance 
with the law. Therefore, the states that have already met that standard 
have little incentive to improve. (See page 22.) 

In the absence of national evaluations or comprehensive information 
systems, gao could not determine whether the reforms have reduced the 
number of unnecessary and inappropriate placements. Although length 
of stay in foster care and caseload size have reportedly declined sub- 
stantially since 1977, the decreases began prior to the enactment of the 
law and cannot be confidently attributed to the reforms. Experts believe 
that the federal requirements were nonetheless beneficial in setting a 
floor of standards for child welfare practice. (See page 38.) 

Although the procedural protections have generally been instituted, pre- 
sent conditions suggest a continuing need for incentives to fully imple- 
ment these reforms and, perhaps, additional efforts by acyf and the 
states to strengthen them. Problems continue in foster care place- 
ments — such as lengthy stays and multiple placements — which moni- 
toring and vigorous services may help resolve. Additionally, changes 
since 1980 indicating increased stress for families have raised the 
demand for foster care and family sei-vices. (See page 55.) 



Pri n PI 1 Fi n i n Foity-eigh t states have passed ac yf's lowest standard of compl iance 

rilllCipdl r lllUlllgb ^^^^ pj^^g reviews— including 13 of the 18 protections— applied to 

at least 66 percent of cases), but 31 states have reached the agency's 
highest standard (15 or more protections applied to at least 90 percent 
of cases). Even the highest of acyf's graduated compliance standards 
does not require that all 18 protections contained in the law are in fact 
provided, despite an earlier gao recommendation that acyf amend this 
system to achieve conformance with the 1980 act (gag, 1984). (See 
pages 24 and 30.) 

However, there is reason for concern with implementation quality. In 29 
states, acyf reviews found that the periodic case review had not been 
held within t^he time required in 2 to 68 percent of cases (the median is 8 
percent). In 27 states, the dispositional hearing had not been held on 
time in 3 to 38 percent of cases (the median is 9 percent). Because many 
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Executive Summary 



States require the courts to conduct the periodic case reviews as well as 
the dispositional hearings, state compliance sometimes falters when the 
courts are unable to conduct these in the manner required. In addition 
limited information suggests that services to facilitate family reunifica- 
tion and adoptions are inadequate, although gao was unable to deter- 
mine the reasons for, or extent of, the shortfall. (See page 27.) 

"° conclusive evidence on the effects of the reforms. Between 
1977 and 1985, national estimates of the median length of stay for chil- 
dren still m care decreased from 31 to 17 months. This reduction 
occurred, however, mostly in the first years of the reforms and seems 
now to have leveled off. The estimated national caseload decreased over 
this period from 502,000 to 276,000, but the bulk of the reduction 
occurred before the reforms* enactment, and the caseload has increased 
slightly over the past few years. The absence of systematic evaluations 
precludes linking these improvements solely to the section 427 reforms 
However, the legislation has been cited in litigation against welfare 
agencies on behalf of the children in their care, thus providing a new 
legal avenue for monitoring their treatment. (See pages 46, 51, and 54.) 

The best available national data indicate a continued need for federal 
incentives for state . eform. At the end of 1985, 15 percent of the 
276,000 children in foster care were still in "temporary" placement after 
5 years. About 27 percent had been awaiting permanent placement for 
at least 3 years, and 21 percent had experienced 3 to 5 different place- 
ments^ While recognizing that foster care may serve the best interests of 
a child for a period of time, these numbers suggest the need for tracking 
and independent review, as well as vigorous services to address the fam- 
ily s problems. Yet, studies in state and local areas have noted infre- 
quent caseworker contacts with parents and the absence of screening 
for health and educational needs. (See pages 55 and 59.) 

Changes since 1980 have raised the demand for these services Reports 
of child abuse and neglect increased between 1981 and 1985 and were 
implicated m 61 percent of the cases entering care in 1985. A rise in 
substance abuse is believed to be a prime contributor. Moreover while 
some states have incorporated the reforms into law, and others have 
modified agency policy, federal monitoring may still be needed to ensure 
that these reforms continue to be applied. (See page 60.) 



Information Gaps 



Oversight of the reforms requires current, national information aboi'l 
slate and local agency behavior as well as the outcomes for children in 
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Executive Summary 



foster care, yet such information was generally unavailable for this 
review, acyf compliance reviews provide the most reliable information 
available on program operation but do not characterize the adequacy of 
protections or services provided. Neither the required state information 
systems nor the recommended national system includes the quality-of- 
care data needed to answer questions about the intended outcomes of 
the reforms for children and families. A national information system, as 
required by Public Law 99-509 but not yet implemented by hhs, could 
correct the inconsistency of the states' definitions, which limits the util- 
ity of current systems for research and oversight. (See page 65.) 



GAO recommends that the secretary amend the department's standards 
for certifying states' compliance with section 427 to ensure that the 
receipt of incentive funds is contingent on the states' meeting all 18 of 
the law's requirements, gao further recommends that the secretary 
promptly comply with the mandates of Public Law 99-509 regarding the 
development of a national information system on adoption and foster 
care. Such a system is a critical first step for informing the secretary 
and the Congress about the efficiency and effectiveness of this program. 



In the absence of reliable information on the quality of care provided, 
the Congress may want to consider mandating evaluations of the effects 
that the reforms have 1 id on improving program services and their out- 
comes for families. 



The department provided written comments on a draft of this report. It 
commended the objectivity and thoroughness of the report and con- 
curred with GAO's recommendations to enforce state documentation of 
all the required protections and to comply with the mandates regarding 
the development of a national information system. The department did 
not concur with gao's conclusions about the effects of the section 427 
reforms, gao believes that the quality of the evidence is not sufficient to 
confidently attribute observed improvements to the reforms. 



Recommendations to 
the Secretary of 
Health and Human 
Services 



Matter for 

Consideration by the 
Congress 



Agency Comments 
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Chapter 1 



Introduction 



Background ^"""S the lS70's, widespread abuses of the foster care system were 

reported. The number of children in foster care at any point in time 
increased to an estimated 502,000, nationally, in 1977 from 318,800 in 
1972.' The median length of stay for children remaining in care was esti- 
mated to be 31 months in 1977. A 1979 study in New York City found 
that the majority of children had entered foster care.as preschoolers 
and those entering before age 2 remained in "temporary" arrangements 
for over 7 years, on the average. This study and others found that many 
children m foster care had numerous different placements over the 
years and had little hope of returning to their families or finding other 
permanent homes. 



The Congress considered this information and, through the Adoption 
Assistance and Child Welfare Act of 1980 (Public Law 96-272), made 
substantial changes in federal child welfare programs under the Social 
Security Act of 1935, in part, to deemphasize the use of foster care and 
encourage greater efforts to place children in permanent homes. The Aid 
to Families with Dependent Children (afdc) in Foster Care program was 
transferred to a new title IV-E in the act, and eligibility was made con- 
tingent on efforts to prevent unnecessary placement. Another program 
was initiated in title IV-E to assist the adoption of hard-to-place chil- 
dren. The states' eligibility for additional Child Welfare Services appro- 
priations, under title IV-B, was made contingent on their implementing a 
variety of procedural safeguards designed to prevent extended stays in 
foster care and to ensure that efforts are made to reunify children with 
their families or place them for adoption. 

In particular, section 427 of title IV-B precludes the states from receiv- 
ing their full share of annual title IV-B appropriations exceeding $141 
million unless they have inventoried and developed an ongoing informa- 
tion system on all children in foster care, instituted a case plan and 
review system, and developed a service program designed to help chil- 
dren remain with or return to their families or find suitable adoptive 
homes, where appropriate. 



Objective and-ScOpe ^" context of conflicting reports about whether abuses of foster care 

were continuing despite the enactment of the 1980 reforms and 




' In this report, we use the term "foster care" synonymoiisly with the term "substitute care" to indi- 
ca e the placement of a child under the care or supervision of the primary state child wlfare aKcncv 

SSiauSuon " ''•""^ "°*"'^' ^'''^ ^""^W ' 
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increased appropriatiof*^ for Child Welfare Services, the ranking minor- 
ity members of the Senate Labor and Human Resources Subcommittee 
on Children, Family, Drugs, and Alcoholism and the House Select Com- 
mittee on Children, Youth, and Famiiies asked us to conduct a compre- 
hensive assessment of-whether the section 427 reforms have been 
carried out, whether they are working, and whether they are still 
needed. (See appendixes I and II for the original request and laier modi- 
fication.) We selected the section 427 reforms as our focus in subsequent 
discussions. 



Because of time constraints, we conducted this evaluation by reviewing 
the published and unpublished evidence currently available and did not 
attempt to collect new information on the program or its implementa- 
tion. Using evidence from prior research and evaluations, commentaries, 
statistical information systems, and agency documents, we assessed the 
information available to answer the committees' questions. We identi- 
fied existing evidence through bibliographic searches and interviews 
with program officials and external experts. We reviewed the literature 
published primarily since 1985, including 125 studies, reviews, and com- 
mentaries. We also interviewed federal agency officials and external 
experts, and we reviewed federal agency documents on the results of 
their review of the states* compliance with the law's requirements and 
allocation of incentive funds. Appendix VI lists the external experts we 
consulted. 

To help ensure the comprehensiveness of this review, the ranking 
minority members asked us to structure it around a comparative evalua- 
tion framework we developed in a previous assignment for the select 
committee (see appendix III).- This framework consists of a standard 
format for describing a program (or program component) and iO general 
criteria for evaluating the need, implementation, and effects of that pro- 
gram. It is intended as a way to formulate questions about a program 
and organize evidence on it. 

In reviewing how Ihe reforms liave been carried out, we examined 
whether they have been implemented as the Congress and the responsi- 
ble federal agency intended (program fidelity) and in a cost-efficient 
manner (administrative efficiency), as well as what the nature and 



-In a previous report, Children's ProjiranLs; A Companuive Evaluation Fnimework and Five Illustra- 
tions. GA0/PF:MD-88-28BU (WiLShington, D.C.: August 31, 1988), wc presented the framework svc 
developed and illustrated iwtential indieators of the general criteria for five specific prognims ser\'- 
ing children and families. 
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extent of relationships are between this program and others and the 
constraints or advantages that are created for program operations 
(interrelationships). 

To determine whether the reforms have worked, we reviewed whether 
the program has reached its intended target groups (targeting success), 
whether it has achieved its intended purposes and outcomes (achieve- 
ment of intended objectives), how the value of these effects relate to 
program costs (cost-effectiveness), and whether the program has had 
effects— desirable or not— on other congressional concerns (other 
effects). 

To address whether there is a continued need for the incentives, we 
examined whether an important and sizable problem still exists (prob- 
lem magnitude); the possible consequences for children, families, and 
society of not addressing that problem (problem seriousness); and 
whether other available resources, public or private, are sufficient to 
adequately address the problem (duplication). 

In coordination with our requesters, we selected two to five indicators 
for each of the framework's criteria on which to focus our evaluation of 
the section 427 incentive funds. Table 1.1 lists the indicators we 
selected. 



Page 12 
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the 10 Criteria ^g^^^^^^^^^^^^^^^^^^^^^^^^^^KK^^^^^l 

Selected for Review General criterion indicator for the section 427 protections 

Implementation State compliance with written case plan, 6-month review, 

Program fidelity and IS-month dispositional hearing 

Adequacy of perman ency planning (reunification) services 

Conformance of Administration for Children, Youth, and 
Families (ACYF) compliance standards with the law 

Interrelationships Extent to which state laws and regulations affect 

implementation of federal reforms 

Extent of coordination with and dependence on other 
agencies and the court system 



Adequacy of state and local agency resources to carry out 
the requirements 



Arimini^trativp efficiencv 


Degree to which ACYF enforces state compliance 




Efficiency of state and local operations 


Effects 


Extent to which the distribution of grants rewards states h 


Targeting success 


compliance 




Extent to which states direct funds to the problem 




Extent to which protections are focused on foster care 




problems 


Achievement of intended 


Decrease in placement difficulties 


objectives 


Increase in receipt of needed care and services 




Improvement in facilitating permanent placements 


Cost-effectiveness 


Costs and benefits of additional case protections 




Costs and benefits of different types of review boards 


Other effects 


Achievement of long-term goals: decreased length of stay 


and caseload size, increased family reunification and well- 




being 




Reduction in state spending on foster care relative to 




preventive and reunification services 




Unintended side effects: increased recidivism, extent of 




burden on court system, establishment of national 




standards 


Need 


Incidence of procedural problems 


Problem magnitude 


Incidence of foster care placement problems 




Demand for foster care placement and services 


Problem seriousness 


Consequences of inadequate child welfare procedures and 




services and of foster care placement problems 


Duplication 


Availability and adequacy of other programs and resources 


that support improvement in family functioning 




Availability and adequacy of other child and family 




protections 



Initially we selected our indicators from the previous report^s list of 
illustrative indicators of the criteria for the Child Welfare Services 
grants as a whole. We revised this tentative list by adapting some 
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indicators and adding others, to reflect the issues of greatest concern to 
the committees and the speciflc components of the section 427 reforms. 

We reviewed the documents identified in the literature search to deter- 
mine both their relevance to the selected indicators and the quality of 
the evidence they provided. We scanned all documents to identify the 
information they contained concerning any of a large number of poten- 
tial measures of each criterion. We then assessed the quality of the 
information we judged relevant against commonly agreed-upon social 
science standards, the issues we considered depending on the nature of 
the evidence. In judging research and evaluation studies, for example, 
we focused on the quality of sampling procedures and methods for con- 
trolling alternative explanations of the findings. In judging statistical 
infoi-mation systems, we focused on the use of standardized data collec- 
tion procedures. 

To develop an empirically based conclusion, if possible, on each indica- 
tor of each criterion, 've synthesized all the relevant infonnation availa- 
ble that met minimum scientiflc standards of quality.-' In turn, we 
combined these conclusions— or the absence of them— to render a judg- 
ment flrst on each criterion and then on each of our tnree basic evalua- 
tion questions regarding the implementation, effects, and continued 
need for the section 427 reforms. Throughout, we conducted this review 
according to generally accepted government auditing standards. 

mis provided written comments on a draft of this report. The comments 
are presented and evaluated in chapter 6 and are included in appendix 
VII. Technical comments have been incorporated throughout the text. 



Strengths and 
Limitations of Our 
Approach 




We believe that structuring this review around the comparative evalua- 
tion framework has resulted in a balanced and comprehensive picture of 
the status of the 1980 reforms in foster care. The multidimensional 
nature of the framework forces attention to issues that might othenvise 
be overlooked, such ..s the need for the states to revise their laws and 
policies to comply with the federal requirements. Using the framework 
has led us to consider aspects of the program that have been successful 
as well as those that have not. It has also identified and made prominent 
areas in which good-quality information is sorely lacking, although it is 
critical for considering decisions aimed at improving the program. 

•'I'r(>};r:.ni I-valuiition and Methodology Division. V.S. General AcwuntmK OHi. r, The Kviiliiaiion Svn- 
thesis, methods paper 1 (\ViLsIiii\«lon, D.C.: April 19a3). 
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However, the indicators we selected for review are, of course, only a 
subset of those that could have been reviewed, and some important 
indicators may have been overlooked. Judging from^experts' comments 
on our previous assignment, the indicators we selected appeared to be 
among the most important, although they were adapted to reflect the 
focus of our review on the section 427 reforms rather than the whole 
program. Our overall judgments are therefore limited to the indicators 
we chose for examining issues flowing from the framework. 

Finally, time constraints on our review made it impossible to both 
review and supplement the existing literature with new data collection. 
Therefore, our ability to draw conclusions in some areas is considerably 
hampered by the meager quantity of credible research existing in those 
eress as well as by the limited amount of publicly available information 
on program operations. 



The remainder of this report presents the results of our review of 
existing evidence on the section 427 reforms. Chapter 2 describes the 
incentive funds and their requirements and the context in which they 
operate. Chapters 3 through 5 provide our evidence and conclusions 
about the reforms on the framework's criteria, organized around estab- 
lishing whether the reforms have been carried out, whether they are 
working, and whether there is a continuing need for the reform incen- 
tives. Chapter 6 provides our recommendations to the secretary of 
Health and Human Services, matters for consideration by the Congress 
to improve progress in this area, and a description of the agency's major 
comments on a draft of this report. 



The Structure of the 
Report 



IG 
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The Foster Care Protections Required for CMd 
Welfare Incentive Funds 



Authorization 



The Child Welfare Services grants program, since 1967 under title IV-B 
of the Social Secunly Act, was permanently authorized in 1935 to assist 
the states m the delivery of child welfare services to children and their 
families. The Adoption Assistance and Child Welfare Act of 1980 (Public 
Law 96-272) added section 42V to the act, requiring the states to imple- 
ment.certam foster care protections in order to receive their full share 
of subsequent increases in Child Welfare Services appropriations over 
S141 million. 



Problems 



Beginning in the mid-1970's, congressional hearings and investigations 
Identified widespread abuses in the foster care system, that many chil- 
dren, for example, 

were unnecessarily placed in foster care, 

spent long periods of time in a succession of temporary arrangements, 

had little hope of returning to their families or finding another perma- 
nent home. ^ 

These problems were believed to result from 

inadequate services provided to strengthen families and prevent their 
separation and 

significant weaknesses in program management that had adverse effects 
on the types of care and services provided to foster children. 



PurDOSeS and Goals ^hlld welfare services grants (title IV-B) assist the states and local 

governments in providing services to children and their families in order 
to protect and promote the welfare of children; prevent or remedy the 
abuse, neglect, exploitation, or delinquency of children; prevent unnec- 
essaiy separation of children from their families; return children in fos- 
ter care to their families or place them in suitable adoptive nomes- and 
ensure adequate care of children in foster placement. 

Section 427 provides an incentive to the states to set permanent place- 
ment goals for each child in foster care, provide the services needed to 
achieve those goals, and periodically monitor each case to determine the 
contmued necessity of placement and appropriateness of placement and 
services— m order to facilitate returning a child home or finding another 
suitable permanent placement. 

1? 
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Program Operation 



The IV-B Grants 



The IV-B grants provide federal matching funds to state agencies for the 
provision of child welfare services for the above-mentioned program 
purposes. Funds provided to the states under title IV-B may be used 
only to a limited extent for foster care maintenance or adoption assis- 
tance services (for which matching funds are available under title IV-E). 
However, an additional incentive to lessen the emphasis on using foster 
care and to increase the emphasis on providing alternative types of ser- 
vices is available: the states may transfer unused title IV-E funds to 
their title IV-B programs, provided the required protections (specified in 
section 427) are in place. 

Although title IV-E funds are limited to cases eligible for afdc, title IV-B 
fund^ are not. There are no federal client income eligibility requirements 
for the receipt of child welfare services. Each state's share of the appro- 
priations for which it is eligible is allocated on the basis of, among other 
factors, the state's per capita income and population younger than 21. 
Grants are, in any case, to represent no more than 75 percent of state 
and local program costs, up to the amount of their allotment. 



The Section 427 
Requirements 



Section 427 provide chat for each fiscal year after 1979, a state cannot 
receive incentive funds— that is, its share of the appropriations for 
Child Welfare Services exceeding $141 million— unless it has met the 
following conditions: 

L completed an inventory of children in foster care for a period of 6 
months -prior to the inventory and determined the appropriateness of 
and necessity for the current placement; 

2. established a statewide information system from which the status, 
demographic characteristics, location, and placement goals of each child 
can be determined; 

3. established a case review system for ensuring that 

a. each child has a case plan designed to achieve placement in the least- 
restrictive (most family-like) setting available, in close proximity to the 
biological parents; 
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b. the status of the child is reviewed at least every 6 months to deter- 
mine the continued necessity of the placement and the extent of compli- 
ance with the case plan and progress toward mitigating the need for the 
placement; and 

c. a dispositional hearing is held, no later than 18 months after the ini- 
tial placement (and periodically thereafter), to determine the future sta- 
tus of the child; 

4. implemented a system of services designed, where appropriate, to 
taahtate the child s return home or other permanent placement. 

Additionally, after the full authorization ($266 million) is appropriated 
for 2 consecutive fiscal years, a state's allotment is to be reduced to its 
fiscal year 1979 level (its share of $56 million) unless it has met these 
requirements and has implemented a system of preplacement preventive 
services. 



Administration ^he program is administered by the Children's Bureau of the Adminis- 

tration for Children, Youth, and Families (acyf) of the office of human 
development services within the U.S. Department of Health and Human 
Services. The bureau helps the states develop their program plans 
reviews those plans, certifies the states' compliance with the section 427 
requirements, and allocates funds to them accordingly. State agencies 
are then responsible for administering the funds, including their distri- 
bution within a state. 



The bureau determines a state's compliance and eligibility for the incen- 
tive funds through both review of state policies and administrative pro- 
cedures and a periodic joint federal-state reading of a random sample of 
case records. The administrative procedures review ascertains whether 
or not the states have developed adequate policies and procedures to 
implement each section 427 requirement. The case record survey deter- 
mines the extent to which the case review system requirements are 
applied consistently throughout the caseload. This case record review 
looks for evidence of a case plan, a periodic review, a dispositional hear- 
ing, and the 18 elements hhs identified from sections 427 and 475 of the 
act, which detail the specific components of these three m^or require- 
ments. Appendix IV shows the correspondence between the law's 
requirements and ACyp's compliance review scheme. 

is 
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Compliance standards for the case record survey are graduated, rising 
regularly as a state receives incentive funds over the years. Once a state 
certifies itself as having the procedural protections in place, the bureau 
conducts an initial (case record) review. To pass this review, the states 
must have established case plan and review procedures and family 
reunification services. Additionally, at least 66 percent of the sample 
cases must contain case plans and indicate that reviews were conducted, 
and at least 13 of the 18 specific elements of case planning and review 
cited in section 427 must be present in the cases. In the year after a state 
successfully passes this review, the bureau conducts a subsequent 
review, in which the percentage of cases required to pass is increased to 
80. Three years after a state passes the subsequent review, the bureau 
conducts a triennial review — its highest compliance standard — in which 
at least 90 percent of the sampled cases must show evidence of a plan, 
periodic review, dispositional hearing, and at least 15 of the 18 elements 
required of them. Thereafter, compliance reviews are conducted only 
every 3 years. States failing a review are generally reviewed again the 
following year. 

ACYF considers that states are eligible for their share of the incentive 
funds for a given fiscal year if they have certified compliance and not 
failed a compliance review for that >car. Those that do not pass are 
informed by the commissioner of acyf that they must return the section 
427 funds received for that year and that they may appeal acyf's deci- 
sion to the departmental appeals board. 



Three other programs authorized under the Social Security Act support 
services to children in foster care and their families. The title IV-E Fos- 
ter Care program is a permanently authorized, open-ended entitlement 
program providing federal matching funds for state expenditures on 
foster care maintenance and related administrative costs for the care of 
children who are eligible for the afdc program. State eligibility for funds 
under title IV-E is linked to the implementation of certain of the section 
427 reforms and, under certain circumstances, the availability of pre- 
ventive preplacement services. Title IV-E also authorizes matching 
funds for financial adoption assistance and for services to lessen the 
barriers to the adoption of children with **special needs." Through tem- 
porary authorization, the title IV-E independent living initiatives assist 
states and local governments in providing services to prepare youths 
older than 16 to leave foster care. 



Relationships With 
Other Programs 
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Title XX of the Social Security Act authorizes social service block 
grants, which support a variety of social services directed at the needs 
of the entire age range. The states may spend a portion of their block 
grant allocation on certain child welfare, foster care, adoption assistance 
1 estimated that the states spend 

sbout $500 million of the $2.7 billion appropriated for these block 
grants (less than 20 percent) on child welfare, foster care, and adoption 
activities. ^ 



Funding and Recent 
Participation Levels 



The full authorization level for the IV-B program is $266 million but 
appropnations have never reached this level. After fiscal year 1980 
appropnations increased from $66.1 million to $239.4 million in fiscal 
year 1988, providing $98.4 million for the section 427 incentive funds in 
that year (see table 2.1). In fiscal year 1982, 35 states were found in 
compliance and received incentive funds under section 427- 49 states 
received funds in fiscal year 1988. 



Table 2.1: Annual 1980-88 Appropriations 
for the Child Welfare Services Grants* 



Fiscal yoar 


Appropriations 


IV-B incentive 
funds 


1980 


$66.1 


$0 


1931 


163.6 


22.6 


1982 


156.3 


15.3 


1983 


156.3 


15.3 


1984 


165.0 


24.0 


1985 


200.0 


59.0 






222.5 


81.5 


1988 


239.4 


98.4 





Because of the limited reporting requirements, the total number of chil- 
dren receiving child welfare services-whether in foster care or not-is 
not known. The American Public Welfare Association, aided by a grant 
from HHS, operates the Voluntary Cooperative Information System 
(vcis), in which states provide information about foster care and adop- 
tion. Although data collection procedures have reportedly improved 
greatly in recent years, the absence of certain items for some states, and 
the use of different reporting periods and definitions across states, has' 
limited the utility of those iata. However, the vcis data are the most* 
reliable available at the national level, since hhs has yet to promulgate 

21 
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final regulations regarding a mandatory national information system. 
According to vcis estimates, at least 276,000 children were in foster care 
at the end of 1985, more than 180,000 having entered, and at least 
170,000 having exited, during that year. Unpublished vcis estimates 
indicate that 282,000 children were in care at the end of 1986 (Gall, 
1989). 



A Hm-ktinn t:inrl Fnctor Section 479 of the Social Security Act (as added by Public Law 99-509, 
AUUpuuil dllU r UbttJI enacted October 21, 1986) mandated that by January 1987, hhs was to 
Care Information establish an advisory committee on adoption and foster care informa- 

SvStem ^^^^ study the various methods of establishing, administering, and 

^ financing a system for the coHection of data on foster care and adoption 

in the United States. The advisory committee's report, delivered to the 
Congress and the secretary of hhs on October 1, 1987, as required, rec- 
ommended the development of parallel mandatory foster care and adop- 
tion information systems, based on individual child case information 
(without personal identifiers). 

The committee also recommended that vcis be maintained during the 
transition period; legislation be enacted to restrict the use of these data 
for purposes other than those for which they were collected, yet make 
public use data files (designed to safeguard confidentiality) available for 
research purposes; and additional federal funds be provided to cover the 
additional costs incurred by the states. The recommended data items for 
the foster care system include deruographic information about a child as 
well as information about the type of placement and previous stays in 
foster care, service goals, availability for adoption, duration of care, 
funding sources, what happens to the child after concluding his or her 
stay in foster care, and relevant information about the child's biological 
and foster parents. While these information items are similar to those 
currently in vcis, the proposed system would represent a great improve- 
ment over vcis by standarr^izing definitions and permitting case-level 
analyses. 

Section 479 further requires that (1) the secretary of nijs report to the 
Congress by July 1, 1988, on proposals for financing and operating such 
an information system; (2) the secretary promulgate final regulations 
for implementation by December 31, 1988; and (3) the regulations pro- 
vide for the system to be fully implemented by October 1, 1991. The 
report was submitted to the Congress on May 26, 1989, but the agency, 
in commenting on our draft report on May 24, indicated that proposed 
regulations were still in the final stages of preparation. 
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The evidence on whether the reforms have been carried out in the states 
is mixed. All but 3 states have brought their laws and policies into line 
\yith federal case plan and review requirements. However, implementa- 
tion at the individual case level varies considerably across the states. 
Federal reviews have revealed problems in the case review system, most 
frequently involving the lack of timeliness in conducting reviews, that 
are often traced to inadequacies in state court performance. Limited evi- 
dence suggests that the availability of services in certain areas may be 
insufficient. 

Although ACYF's graduated federal compliance standards rewarded the 
states for eariy improvements in implementing the federal reforms, its 
highest standard does not require full compliance; with the law. This 
removes the incentive for improvement for the 31 states that have met 
that standard, acyf's enforcement of the incentive funds sanctions has 
generally met legal requirements, but delays in determ: ing the states' 
compliance may a)30 have weakened the incentives for state reform. 
Table 3.1 summ-irizes our findings on the implementation indicators. 
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Table 3*1: Implementation of the Foster Care Reforms 



Criterion 



Indicator 



Finding 



Program fidelity 



State compliance with written case plan 



Most states meet this requirement; only 1%-10% (3% on 
average) of cases in 7 states were out of compliance 



State compliance with 6-month review 



The states have established this protection, but 2%-68% 
(median of 8%) of case reviews In 29 states were not timely 



Staie compliance with 1 8-month 
dispositional hearing 



The states have established this protection, but 3%-38% 
(median of 9%) of case reviews in 27 states^ were not timely 



Adequacy of reunification services 



Little information, although services are seen as Insufficient 



ACYF compliance requirements 



Compliance reviews permit flexibility in Implementation; 
standards do not require full compliance with the law 



Interrelationships 



State laws and regulations affecting 
implementation 



Most, if not all, states have modified some aspect of state 
law or policy to conform to the federal mandate 



Agency coordination 



Information is generally lacking, but where courts are 
involved, coordination seems to have strained heir 
capacities 



Adequacy of resources 



Anecdotal reports suggest caseworker overload and 
inadequacies In services and caseworker training 



Administrative efflcleticy 



ACYF compliance enforcement 



Reviews probably helped states improve their compliance 
but, by requiring less than full compliance, standards are 
currently not high enough to ensure continued improvement 

Only 1 of 21 payments mads to states found Ineligible has 
not b een recovered 

Delays in resolving state appeals, and in conducting follow- 
up reviews, permit continued payments to 6 states that 
failed their most recent review 



State efficiency 



Little information is available 



The states implemented the requirements specified in section 427 by 
making legislative and policy changes in areas dealing with case plans, 
case reviews, and services to promote permanent placements. Most 
states have established the basic procedural requirements and have thus 
probably improved the monitoring of their handling of children in foster 
care. However, data from acyf compliance reviews and other sources 
indicate that the completeness of these procedural reforms varies con- 
siderably across the states. Further, acyf's compliance certification pro- 
cess, as currently configured, does not require eviden^'e of compliance 
with all 18 protections specified in the law. 

To evaluate the fidelity of federal and state agencies' compliance with 
the law, we supplemented our review of the publicly available literature 
with a review of acyf compliance standards and procedures, as well as 
the results of their state section 427 compliance reviews. 




J Q Page 23 GAO/PEMD'8917 ImplemenuUon and Effects of Foster Care Reforms 



Program Fidelity 



Cliaptcr 3 

Have the Rcfoms Been Carried Out? 



State Compliance With 
Section 427 



Table 3.2: Number of States in 
Compliance With Section 427 
Requirements 1983-87' 



Most states have established the basic procedural requirements of the 
law, although the completeness of their application of the various pro- 
tections at the case level varies, acyf has certified all but 3 states as 
having the policies, procedures, and services in place to comply with 
section 427. Table 3.2 presents the results of the most recent acyf com- 
pliance review of each state. Forty-eight states have pas.oed the agency's 
lowest level of compliance (information and service systems in place and 
case protections applied to at least 66 percent of cases), and 31 states 
have reached its highest compliance level (case protections applied to at 
least 90 percent of cases). (The outcomes of the states' compliance 
reviews are in the table in appendix V.) 



Action 


Percent of cases required 
for compliance 


Number of 
states 


Cumulative 
number 


Review type " 


Triennial 


Up to 90% 


31 


31 


Subsequent 


Up to 80% 


12 


43 


initial 


Up to 66% 


5 


48 


Certified compliance** 




2 


50 


Withdrew certification 




1 


51 



"As determined by HHS (or fiscal years, excluding the territories. 

'=Tvvo states certified their compliance with the law and await ACYF review while another stale has 
withdrawn its application to: the incentive (unds. o"'«"iv.i »ia«, ii« 

ACVF case record reviewers frequently mention in their reports aspects 
of state policy and procedures that are relevant to our concern for 
improved compliance with federal requirements. For instance, these 
reports have frequently made recommendations for greater automation, 
regular updating of the required statewide information system on foster 
care cases, clarification or revision of state policies, additional staff 
training and monitoring of compliance, and establishing systems to set 
and track target dates for the case reviews and hearings. 

ACYF compliance reports provide the most comprehensive .nnation on 
program operations and are the primary data sources for o program 
fidelity indicators. From these reports, we found that written foster care 
case plans are fairly universal among the states, although many states 
have had difficulty in conducting the periodic reviews and dispositional 
hearings within the time periods specified by law. However, acyi-' 
reports do not characterize the adequacy of the protections or services 
provided to meet the needs of children in foster care. Information from 
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selected states and projects does not permit us to systematically charac- 
terize the adequacy of reunification services, although it does suggest 
that families' access to reunification services is limited. 

Case Plan Requirements The existence of a written case plan is a m^or requirement in the law, 

and almost all the states have ensured that case plans are developed for 
all children. However, the literature rarely addresses the conformance 
of the case plans with the relevant requirements of sections 427 and 
475. The m^ority of information on this indicator came from acVF com- 
pliance rerorts. 

The results of the most recent round of acyf compliance reviews (for all 
stages of review) indicate that sample cases failed in only 7 states (from 
less than 1 to 10 percent, 3 percent on the average) b^^cause of the 
absence of a written case plan. However, federal reviewers noted that in 
18 states, there were deficiencies in the case plar3 they reviewed, the 
most common of which was that the plan was not a discrete document. 
Other reviewers* comments in a few states indicated that there was no 
system to project dates or milestones or that the plans were not updated 
routinely. 

In terms of contents, the case plan identifies, among other things, the 
goals for the child and family, the action to be taken by all parties, the 
services to be provided, and dates for the completion of objectives. In a 
prior study of early state implementation (gao, 1984), we found that in 
5 of 7 states in which case records were re\fiewed^ the contents of the 
Ccise plan were generally in accordance with federal requirements. We 
determined that in states with written case plans, 98 percent of the cas^ 
records met the 9 criteria identified by acyf as components of the case 
plan. (Two states had not prepared a written case plan for foster chil- 
dren at this time, although the report indicated that these states were in 
the process of implementing the requirement.) More-recent data from 
vcis in 1985 indicate that 6 percent of the cases had no goal specified, 
while another 19 percent had **long-term foster care** as a case goal 
(Maximus, 1988a). It is unknown what proportion of these cases repre- 
sent stable placements — with relatives, for example — or failures of case 
planning. 

Data from other sources have raised questions about various other sub- 
stantive aspects of the case plans, such as the appropriateness of the 
plan and adequacy of progress toward permanency, whether specified 
services have been provided, whether parent-child contacts were ade- 
quately documenteiv, And the overall usefulness of the information in 
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case plans (Maryland Citizen Board for Review of Foster Care of Chil- 
dren, 1986b; Stein, n.d.(a); Yoshikami and Emlen, 1983). Limitations in 
these sources preclude U3 from quantifying the extent of these problems 
more accurately or generalizing these findings across the states. 

Case Review System The limited evidence on the implementation of the case review system 

Requirements requirements suggests that since 1980, the states have formalized the 

periodic review procedures already in place and have developed disposi- 
tional hearing procedures in line with federal requirements. As a result 
of state implementatiu- jf federal requirements, the role of state courts 
in case reviews has increased, and state policies and procedures have 
become more uniform. However, the evidence from acyf compliance 
reviews and selected state data indicates that many states have recur- 
ring problems with conducting the periodic reviews and dispositional 
hearings within the time periods specified in the law. 

The case review system is quite complex, because the law grants the 
states flexibility in deciding which type of review body to use when con- 
ducting foster care reviews. Section 475(5) specifies that the states may 
use internal or external review for the 6-month review and judicial or 
court-approved administrative body review for the 18-month disposi- 
tional hearing. Internal reviews are conducted by persons employed by 
the agency, including at least one reviewer with no direct responsibility 
for the case. External reviews are typically conducted by a body sepa- 
rate from the agency. They might include the following types of review: 
judicial, in which a judge reviews all cases; court-administered, in which 
staff members of the court or court-approved, trained volunteers con- 
duct reviews; and those that are conducted by an independent board of 
citizen volunteers ("citizen review") (Moses, 1987). A 1986 survey of 
the 50 states indicated that 28 states combined more than one method 
(Smith, 1986), and a 1984 survey of states (with 37 respondents) indi- 
cated that 14 states had two review systems in which reviews were 
alternately^or concurrently conducted (Mosos, 1987). The extent of 
court involvement in the case review system is exhibited in the 1986 
survey, whicn found that 44 states employed court (external) reviews, 
34 states had administrative (internal) reviews, and 17 states used citi- 
zen (external) reviews (Smith, 1986). 

The inclusion of the case review system requirements in state law or 
policy has been fairly complete among the states. Indeed, a 1982 study 
of the periodic review of foster care cases reported that all the states 
had some form of review mandated by state agency policy, statute, or 
regulation before the federal reforms in 1980, But by 1982, a majority of 
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States reported having formalized their periodic review procedures in 
state policies and statutes and added specific policy directives concern- 
ing the timing and conduct of case reviews (JWK, International, 1982). 
A study of the dispositional hearing requirement in 1983 found that 14 
states reported having all the components of the dispositional hearing 
requirements in place in 1980. By 1983, 38 states reported having modi- 
fied either law or policy to meet the federal requirements (Cahalan, 
Ctook, and Dodson, 1983). A study by JWK, International, found that (1) 
state courts had come to play an increasingly important role in case 
reviews and (2) differences between the states in terms of review 
requirements had begun to diminish; that is, their requirements had 
become more uniform as they came into compliance with the provisions 
of federal legislation (JWK, International, 1982). 

Problems With the Timeliness of Reviews and Hearings . Federal compli- 
ance reviews found, and selected state data indicate, that many states 
have not conducted the reviews and hearings in the time periods speci- 
fied in the law. Data from 3 states prior to 1988 indicated that 20-25 
percent of the children did not have a periodic case review within the 
required 6 months, some 24 percent, on the average, across these states 
(Arizona Supreme Court and State Foster Care Review Board, 1987; 
Lowry, 1988). However, the validity of these data could not be deter- 
mined from the source material, and the number of states is too small to 
permit generalization. 

Data from the latest round of acyf compliance reviews indicate that the 
most common cause for failing a compliance review was not conducting 
the reviews and hearings within the specified periods. In 29 states, at 
least one sample case had not had its periodic review within the 
required 6 months.* The percentage of cases that failed in these states 
ranged from 2 to 68 percent, with a median of 8 percent. In 27 states, at 
least one sample case failed the compliance review because the 18- 
month dispositional review was not held on time. Three to 38 percent of 
sampled cases failed in these states, with a median of 9 percent. 

Federal reviewers made various recommendations in their compliance 
reports to change state procedures, which they thought would enable 
the states to meet the federal requirements. They included developing 
case tracking systems, negotiating with juvenile and family courts to 
improve their timeliness, encouraging state courts to empower advisory 



'acyf instmcts case reviewers to consider .1 case out of compliance when a review or licaring is at 
least 1 month late. 



ERIC 



Page 27 GAO/PEMD-89-17 Implementation and Effects of Foster Care Reforms 



Chapters 

Have the Reforms Been Carried Out? 



boards to act in their behalf, coordinating the various review efforts 
where there is more than one review body, and reducing and standard- 
izing the forms and procedures. 

Problems Relating to Thoroughness of Reviews and Hearings , The acvf 
compliance review reports indicated problems with the thoroughness of 
reviews that touched on some of the more specific requirements of the 
law. These problems concerned whether the reviews projected a likely 
target date for a child's return home or an alternative permanent place« 
ment, were open to the parents' participation, determined the extent of 
progress made on the causes of placement, and included a neutral third 
party in administrative review panels. 

Federal review reports rarely mentioned the procedural safeguards per- 
taining to dispositional hearings, although recommendations for coiTec- 
tive action were made in specific instances, acyf found that some states 
were not holding periodic dispositional hearings for children after their 
designation to long-term foster care. Other states had inappropriately 
excluded from these review requirements special populations that iins 
considered to be eligible for them, such as refugee minors, children in 
preadoptive placements, and children voluntarily placed in foster care. 
In addition, one study found that parents who voluntarily placed their 
children were more likely not to be allowed to play a part in deciding a 
child's placement, were restricted to few visits with the child, and were 
not kept abreast of the child's progress, location, or change in placement 
(Cox and Cox, 1984). 

Reunification Services We were unable to accurately detemine the extent of state implementa- 

Kequirements tion of reunification services because of the absence of systematic evi- 

dence in the published literature and acyf compliance review repoits. 
Limited evidence suggests that services may be insufficient in some 
areas. The paucity of information about reunification services, in our 
opinion, can be attributed in part to the fact that tiiese services have not 
been described in acyf compliance review guidelines, are only vaguely 
defined in practice, and have myriad designations. In addition, reunifi- 
cation services are frequently lumped together in the literature with 
prevention placement services and are not studied separately. 

One study examined case record and caseworker data from early 1983 
relating to placement prevention and reunification services in 5 states 
that had been certified on September 1, 1982, as meeting the basic 
requirements of section 427 (Yoshikami et al., 1984). In spite of the fact 
that these states had met the acyf criterion for the system of family 
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reunification services, caseworkers reported high availability of services 
to reunify families in only one third of the agencies. Indeed, the 
caseworkers' reports indicated that services directed toward reunifica- 
tion were less available than those directed toward placement preven- 
tion. Also, caseworkers reported that cases receiving reunification 
services were more likely than placement prevention cases to have vari- 
ous types of dic^bling conditions, conditions that may have been less 
amenable to help from existing services. 

Recent anecdotal and other information from selected states and child 
welfare advocates and practitioners suggests that services to facilitate 
family reunification continue to be inadequate. A 1985 survey of coun- 
ties in Minnesota, for instance, indicated that family-based services 
(both placement prevention and family reunification) were provided in 
only 75 percent of the counties (Minnesota Department of Human Ser- 
vices, 1987). The Arizona foster care review board also noted the 
absence or shortfall of certain reunification services. Finally, several 
child welfare advocates testified at hearings before the Select Commit- 
tee on Children, Youth, and Families in the spring of 1988 about the 
inability of some states and communities to expand or maintain effec- 
tive efforts to promote reunification (Lowry, 1988; Babcock, 1988; 
Weinberg, 1988; Allen, 1988; Liederman, 1988). 

Indirect evidence from acyf's compliance reviews indicates that the rec- 
ord of implementation in the states is mixed, acyf reviewers look for 
evidence of a system of services only during the administrative reviews 
and only occasionally note perceived strengths and weaknesses of such 
services in their case record review reports. Federal reviewers praised 
the efforts being made in 17 states to help children remain in their own 
homes or be placed for adoption. However, reports in 5 states noted that 
cases they reviewed reflected weaknesses or inadequacies in reunifica- 
tion sei^vices. 

Other subnational studies indicate that barriers to parent-child contacts 
exist, without determining the precise causes of these barriers. In a 
review of research, Hess (1987) found the relationship between 
caseworker practices to promote parental visitation and actual visiting 
inconclusive. For instance, Hess cited a study in which only 70 percent 
of the cases had actual or inferred visitation contracts in the case plans, 
in spite of the agency's policy requiring visitation when the goal is fam- 
ily reunification. Parents who did not have a visiting schedule, or who 
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were told to request a visit when they wanted one, did not visit. How- 
ever, Hess also noted that another study found that low parent motiva- 
tion was a primary factor in the low frequency of visits. 

Only one study addressed the goal of permanency (or reunification) ser- 
vices of preparing the child and family in advance for return home (see 
Rzepnicki, 1987). In a survey of parents in a project in Oregon, only 57 
percent reported receiving advice from caseworkers in preparation for 
their children's returning home, and 59 percent felt that their 
caseworkers had inadequately prepared them. The author also noted 
that there are no data regarding the quality of such services when they 
do exist. 



ACYF Compliance Review Today, 8 years after the reforms were enacted, even acyf's highest corn- 
Standards and Procedures pliance standard does not require the states to show evidence of provid- 
ing all the protections specified in the law. In the triennial review, acyf 
does not consider a case to be out of compliance— that is, to "fail" a 
review— unless (1) it is missing a case plan altogether, (2) the periodic 
review or hearing was not held within the time required, or (3) 4 or 
more of the remaining 18 protections are missing. Thus, acyf reviews 
place more emphasis on whether the required case plans exist and 
reviews are held on time than on how well they are carried out. In a 
1984 report, we concluded that the 1980 act required the states to apply 
all the section 427 requirements to their caseloads before they qualify 
for any incentive funds and that hhs must enforce these requirements 
(GAO, 1984). Now, as then, we do not believe the secretary of nns has 
discretion to allow a state to provide fewer than all 18 protections to the 
caseload. The secretary does, however, have discretion to determine the 
percentage of cases that must include all 18 protections before a state 
can be found in compliance. 

Apparently in recognition of the gradual process of implementing 
change, acyf devised a graduated series of compliance standards that 
require the states to exhibit stricter adherence to the law over time. In 
the firot years after the reforms, when the states were beginning to 
change their laws and practices to comply with the federal require- 
ments, this graduated series of standards may have encouraged them to 
keep improving their performance. Now that 31 states have already 
passed the standard of the triennial review, acyf has no higher standard 
to require of them. But, since this standard falls short of requiring com- 
plete conformity with the law, ac»''s certification process provides little 
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incentive for improvement beyond the level of that standard to achieve 
full conformance with the law. 

It should also be recognized that acyf compliance reviews focus on the 
procedural aspects of the foster care system (that is, on whether the 
required plans exist and reviews are timely) rather than on the sub- 
stance of the protections (that is, on how effective they are in improving 
outcomes for children), acyf guidelines for conducting the compliance 
reviews, consistent with the law, emphasize the form and presence of 
case documentation, the existence of reviews, and matters of due pro- 
cess. The federal reviewer is directed only to ascertain whether, during 
the periodic case review, for example, the review body addressed the 
appropriateness of the child's foster care placement, not to indepen- 
dently ascertain the appropriateness of that placement. Thus, in its sec- 
tion 427 compliance reviews, acyf does not attempt to judge how 
effective the periodic case review has been for ensuring the child's 
appropriate care and placement or how competent the review body was 
in making its own determination. 



InterrelationshiDS Limited research is inconclusive regarding state implementation in such 

^ areas as coordinating state law with federal requirements; adding to 

existing, and developing new, administrative linkages between state 
agencies; and developing additional child welfare service components. 
The literature does not address these issues in any detail, and that 
which is available tends to be primarily qualitative. For instance, the 
greater involvement of state courts in the child v/elfare system has 
encouraged the closer monitoring of children in foster care, although 
this involvement has reportedly created problems and strained capaci- 
ties. Questions have been raised, but not definitely answered, about 
whether the states have sufficient resources to adequately meet the 
needs of children in care and their families. 



State Laws Affecting 
Implementation 



The incentives contained in the Adoption Assistance and Child Welfare 
Act of 1980 led the states to implement extensive changes in law and 
procedure in order to meet the new legislative mandate. For example, a 
50-state survey conducted in 1986 found that from 1983 to 1986, the 
states enacted nearly 1,000 laws relating to child abuse and child wel- 
fare. However, this figure is only an indirect measure of the states' 
responses, because it encompasses legislation that spans the full range 
of issues from improved treatment of child victims in courtroom pro- 
ceedings to the establishment of foster care review boards (Smith, 
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1986). We were unable to identify any comprehensive studies detailing 
the state legislative changes following the enactment of the federal legis- 
lation; information about the extent to which state laws promote or hin- 
der actual implementation of the reforms tends to be piecemeal. 

One study that evaluated the implementation of the dispositional hear- 
ings requirement mentioned that there were disparities with state law in 
this area. One disparity arose over the absence of an 18-month hearing 
requirement in state law. Another disparity concerned the court's role in 
placement decisions because some state laws dictated that once the 
court determined custody, it was the agency's responsibility to deter- 
mine placement (Cahalan, Cook, and Dodson, 1983). In another area, a 
federal compliance review raised questions about the adequacy of 
reviews in a state that required hearings more frequently than federally 
required. The state was advised to lengthen its hearing periodicity in 
line with federal requirements in order to improve the thoroughness 
with which reviews were conducted. In addition, the procedural protec- 
tions for terminating parental rights in order to free a child for adoption 
can lengthen a child's stay in foster care, accounting for an average of 
21 months (Maryland Citizen Board for Review of Foster Care of Chil- 
dren, 1986a). 



Coordination With and 
Dependence on the Court 
System 



Supporting documentation for a resolution passed by the American Bar 
Association (aba) concludes that with the advent of required reviews 
and hearings, the courts have become more involved in the child welfare 
system, and procedural changes in the states have brought a new level 
of complexity to the system. For instance, aba commented that juvenile 
court cases involving child abuse and neglect have become much more 
complex because there is frequently a whole series of hearings as the 
child moves through the system and because law and procedure in this 
area have become more detailed and individual cases are more 
demanding. 

New demands generated by Public Law 96-272 have been placed on the 
state court system that are reported to have strained the capacity of 
some courts to assimilate and effectively manage the changes. The 
result is that the performance of state courts in meeting federal require- 
ments has become an important factor in the determination of state 
compliance, aba concludes that some courts have not kept up with 
advances in court procedures that might help avoid unnecessary court- 
'•elated delays and inefficiencies, noting that most court systems have 
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not yet comprehensively examined their court procedures in foster care 
cases (American Bar Association, 1988). 

Federal re\'iewers of state compliance with the reforms found that some 
states that rely on the courts to conduct periodic reviews were out of 
compliance because of repeated failures of the courts to conduct timely 
or thorough reviews. Those states were advised to institute administra- 
tive review boards in order to gain more control over the timely conduct 
of reviews. 



Coordination With Other 
Service Agencies 



The literature we reviewed does not examine the issue of services coor- 
dination between the various health and welfare agencies. While it is not 
uncommon for the states to operate distinct child welfare, juvenile jus- 
tice, and mental health systems for different populations of children 
with separate residential programing for each, how this has affected the 
implementation of federal reforms could not be determined. 



Adequacy of Resources to 
Meet Needs of FamiUes 
and Children 



We found no recent national data regarding state and local agency 
resources to carry out the federal requirements. However, inadequacies 
in local resources have been mentioned by various social workers and 
child welfare activists, which, if widespread, have compromised imple- 
mentation (Gallup, 1988; Allen, 1988; Babcock, 1988). 

Instances of resource inadequacies, which have been reported in the 
literature, include the following: 

The American Bar Association asserts that the family court system is 
overburdened, and there is a concern about the effects high judicial 
caseloads are likely to have on the quality of decisionmaking about 
removing children from their homes. According to aba, the federal gov- 
ernment has contributed to the problem of inadequate judicial resources 
because the federal requirements make substantial demands upon the 
courts. Yet, financial incentives are directed to the child welfare agen- 
cies rather than to the courts (American Bar Association, 1988). 
One legal activist mentioned that in 25 percent of the cases reviewed in 
Louisiana in which the children were in placement and the plan was to 
return them home, there were no resources available to meet the needs 
identified for these families (Lowry, 1988). 

Some caseworkers complained of being burdened by paperwork associ- 
ated with permanency planning (Maryland Citizen Board for Review of 
Foster Care of Children, 1986a; Hurst, 1988). 
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Some commentators have warned that when a caseworker leaves the 
system— and apparently a high turnover rate is not unusual— a case 
may go an extraordinarily long time before being reassigned. 

Some experts expressed concern about the qualifications and adequacy 
of training for caseworkers. One recent survey of 5,000 child welfare 
workers indicates that in 1987, only 28 percent of the respondents had a 
bachelor's degree or higher in social work. However, this study noted 
that there was a slight shift in the distribution of caseworkers, com- 
pared to 1978, toward more advanced training among the respondents 
(Liebermann, Hornby, and Russell, 1988). In addition, although in-ser- 
vice training and support seem to be limited, one study reported that the 
m^ority of caseworkers had received recent training in reunification 
services (Yoshikami et al., 1984). 

Another concern raised in the literature is that the size of caseworkers' 
caseloads is prohibitive, although the evidence is inconclusive about 
whether these figures actually indicate that resources are inadequate 
One report mentioned that caseload figures ranged as high as 40 to 80 
cases at a time (Edna McConnell Qark Foundation, 1985). Another 
source mentioned 40 active cases when the professional standard is 20 
(Gallup, 1988). However, there are no reliable national figures on aver- 
age caseload size. Studies of individual projects have reported much 
lower caseloads, in keeping with their focus on providing intensive fam- 
ily services, but they are probably not representative (Yoshikami et al 
1984; Fraser, Pecora, and Haapala, 1988; Maryland Citizen Board for 
Review of Foster Care of Children, 1986a; Nelson et al., 1988) 



Administrative 
Efficiency 



ACYF's enforcement of the incentive funds sanctions has met legal 
requirements but, through delays in determining states' compliance, 
may have weakened the incentive these funds provide for states to fully 
implement the section 427 protections. Although ACYFhas not issued 
final regulations providing detailed guidance to the states on the 
requirements created by the law, the current federal compliance review 
mechanism has probably helped the states improve their performance in 
the early years. Our conclusions about the efficiency of state and local 
operations must remain tentative because of the very limited informa- 
tion about state operations. 
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ACYF has been diligent about recovering incentive payments once a state 
has been finally determined to be ineligible for those funds. However, 
delays in acyf reviews of states' compliance, and in hhs decisions in 
appeals of acyf compliance decisions, have permitted some states to con- 
tinue to receive payments for which they may not be eligible. 

After a state is finally determined to have failed to meet compliance 
standards for a given fiscal year, acyf declares the state ineligible for 
section 427 funds for that year and typically recovers them by sub- 
tracting them from the funds for which the state was eligible in a suc- 
ceeding year. In only 1 of the 21 instances in which a final 
determination was reached did acyf fail to recover the funds ($832,216 
to Ohio for fiscal year 1984). When we brought the Ohio case to their 
attention, acyf officials stated their intent to promptly correct this over- 
sight and recover the funds. 

Timeliness of ACYF Compliance In recent years, the process of reviewing states' compliance has slowed 
Reviews down, in large part because of the numerous appeals of acyf's decisions 

on states' compliance. This has led to a weakening of the intended link 
between states' application of the protections and their receipt of the 
incentive funds. Through 1988, the states have appealed acyf's decision 
in 17 of the 25 instances in which they failed their compliance reviews. 
ACYF has been upheld in an overwhelming majority (14 of 17) of these 
appeals, but the appeals process can take up to 2 years before a final 
decision is reached. Because acyf does not consider the compliance deci- 
sion final until after the appeals process has been completed, it can take 
up to 5 years after the fiscal year at issue for the funds to be recovered. 

Moreover, acyf — particularly in recent years — has elected not to review 
a state's performance for the years succeeding the failure of a compli- 
ance review while a state's appeal is in process. Thus, some states have 
continued to receive funds for up to 4 years after failing a compliance 
review without acyf's assessing their eligibility for those funds. As we 
detailed in another report, this has resulted in payments of about $24.7 
million since 1984 to 6 states that may not have been eligible for those 
funds (GAG, 1989b). In discussions of these matters, acyf officials indi- 
cated that a follow-up review is currently under way in 2 of these 6 
states and that they now plan to schedule 2 more states for review, 
because those states' appeals were dismissed or overturned by the 
departmental appeals board in April 1989. In the report referred to 
above, we recommended that acyf promptly rereview states that fail 
compliance reviews — regardless of their appeals status — in order to 
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ACYF Guidance on the 
Requirements 



protect the integrity of program funds and the incentive fund 
mechanism. 

Since the enactment of federal legislation, concerns have been raised 
about the specificity and clarity of the guidance acyf provides to the 
states regarding compliance standards. In an earlier report, we criticized 
HHS for providing little guidance through regulation in the first few 
years after the enactment of the legislation (gao, 1984). We found that 
the regulations regarding compliance review guidelines were largely a 
restatement of the statute and provided little additional guidance to 
help the states understand the requirements. 

ACYF subsequently issued program instructions and policy announce- 
ments that have provided additional guidance to the states. A handbook 
for conducting section 427 reviews was compiled from these instructions 
and announcements in August 1988, but more-detailed regulations have 
yet to be issued. In addition, the comments in the review reports indicate 
that federal case readers were sometimes quite flexible in their interpre- 
tation of the guidelines. For example, the law requires a written case 
plan, and the review guidelines instructed reviewers to ascertain 
whether there was a discrete case plan document. Yet, review reports 
for 4 of the 31 states that passed the triennial review noted that case 
files were missing a discrete case plan document that could be shared 
with the child's parents. 

The current federal compliance review mechanism evidently has pro- 
vided useful guidance to the states, which has probably helped them 
improve their procedural compliance but is no longer an efficient incen- 
tive to improve. The agency's application of graduated or incremental 
standards to measure state compliance rewarded gradual improvements 
in the early phase of implementation. Of the 7 states that failed the first 
review and whose funds were initially disallowed, 6 ultimately 
improved their performance sufficiently to pass a later review; 4 of 8 
states whose funds were disallowed in a subsequent review ultimately 
passed. However, 31 states have already passed acyf's highest compli- 
ance standard. In view of our finding that this standard requires less 
than full compliance with the law, we believe that continuing to test 
those states for this standard may be an inefficient use of the agency's 
resources. 



Incremental Standards as an 
Incentive for Early 
Improvements 
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Efficiency of State and 
Local Operations 



Very little of the published literature deals directly with the efficiency 
of state and local operations. However, federal agency officials 
expressed their concern about the effects of increased paperwork on 
casework. The concern was that paperwork rather than children's needs 
may now be driving the child welfare system and leading to conditions 
in which the caseworkers are overworked, which reduces their ability to 
manage their caseloads. 

A study of social workers' perceptions of administrative review found 
their perceived benefits to be that they facilitated family participation 
and reunification, reinforced goal-setting and planning, ensured case 
monitoring, provided an objective and thorough review of plans, identi- 
fied needs and resources, and pressured the family to cooperate 
(Leashore, 1986). The limitations they perceived in the administrative 
review were the panel's unfamiliarity with case histories, insensitivity 
to child and family issues, unrealistic goals or recommendations, and 
insensitivity to workers. Other problems mentioned by the social work- 
ers in that study concerned the limited resources to implement recom- 
mendations and the time-consuming nature of the reviews. 
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Although the case plan and review requirements are reasonably well 
focused on the performance of the system as it copes with the problems 
of children's experiencing lengthy unplanned foster care stays, informa- 
tion is unavailable to determine how well the incentive funds are 
targeted within the states to improve services or procedures. The 
absence of conclusive evidence precludes our attributing the reductions 
in institutional placements and in children's experiencing multiple place- 
ments, or the dramatic national reductions in lengthy stays and caseload 
size, to the reforms. There is little information on whether placements 
and services are more appropriate to the needs of these children and 
families and on the full costs of ihese protections. However, the federal 
requirements have set a standard and thus provided an avenue for the 
courts to at least monitor the treatment of children in state care. Table 
4.1 summarizes our findings on each indicator of the effects criteria. 



Table 4>1: Eff ects of the Foeter Cam Reforms 
Criterion 



Indicator 



Finding 



Targeting success 



Distribution of state grants 
Focus on problems 



Gross levels of state compliance are rewarded, particularly 
over time ' 



State distribution of funds 



Achievement of intended Decrease in placement d»fficulties 
objectives ^ 



Case reviev^s are v^ell focused on the problem of extended 
unplanned stays 

Unknov^n, but funds do not compensate courts for 
increased responsibilities 



Receipt of needed care and services 
Facilitation of permanent placements 



Reductions in institutional placements and in multiple 
placements may stem from the reforms 

It is unknov^n v^hethcr unnecessary and other inappropriate 
placements have been reduced 

Little information is available 

Increased pfoportioni* of children have permanent 
placement goals 



Cost-effectiveness 



Other effects 



Additional protections 



Different review bodies 



Long.term goals 



Unknown; burden of reforms has not been quantified 

No clear advantage, but citizen volunteers may be less 
expensive and provide additional perspective 



Spending on services versus main tenance 
Unintended side effects 



Speedier departures from foster care and reduced caseload 
sizes may stem f.om the reforms 

Reviews may have increased adoption as well as 
reunification 

It is unknown whether children <nd familie s are better off 
Little information is availa ble " 
Speedier departures may have increased returns 
Courts* additional burdens have not been quantified 

A new legal avenue has been created for monitoring foster 
care 



(it) 
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Targeting Success 



Distribution of State 
Grants 



The allocation of incentive funds among the states reflects gross differ- 
ences in their compliance. The amounts of incentive funds dispersed in a 
year to the states eligible for them do not ly lect the graduated levels of 
compliance agyf recognizes, because these funds are allocated through a 
formula based on population size and per capita income. However, to the 
extent that the federal eligibility certification process described in chap- 
ter 2 identifies acceptable levels of compliance, the allocation of incen- 
tive funds properly rewards perfonnance,.particularly over time. That 
is, states slow to certify compliance and meet agyf standards received 
incentive funds over fewer years than other states. In a notable excep- 
tion, however, incentive funds have continued to be paid to 6 states 
while they appealed their compliance review failures. 



Reform Focus on Foster 
Care Problems 



The design of the required protections is well focused to reach tl\e most 
problematic cases— those in foster care for extended periods of time. 
The 18-month dispositional hearing, if held on time and in the required 
manner, is a well targeted way of combating lengthy unplanned stays in 
foster care. However, states that exempt from these hearings children 
assigned to long-term foster care, but not to a permanent placement, or 
children who have been freed for adoption but not yet adopted are 
poorly targeting these resources to tho identified problem. These 
arrangements may also require monitoring to ensure that the antici- 
pated permanency is achieved. The national data available on the 
reduced percentage of children who stay in care for a very long time 
suggest that these protections may have been well targeted for this 
group of children, but the evidence is not conclusive. 



Distribution of Funds financing structure precludes identifying whether the incentive 

W'th'n 9f«tp^ ^^^^^ ^^^^^ spent specifically on additional case management activi- 

W linin Maies ^..^^ ^^^^ example, preparing for and conducting case reviews) or for pro- 

viding additional services. These funds do not have a legislatively 
prescribed use different from the rest of the title IV-B funds. The d-<>ta 
the states provide to the federal agency indicate only the anticipated use 
of federal, state, and local funds for a range of child protection, foster 
care, and adoption-related activities. According to agency officials, these 
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data do not provide reliable information on either the actual state allo- 
cation of funds to case management and services or the total funds 
expended. 

In at least one respect, the funds are not targeted to one party that 
shares responsibility for the intended behavior change: the courts 
Although the IV-B grants may fund activities associated with cariying 
out the section 427 requirements, these funds are provided to the state 
child welfare agencies and not to the courts, which in many states are 
responsible for conducting both the periodic reviews and the disposi- 
tional hearmgs. Claiming that these reviews require significant but 
unestimated, amounts of court time, the American Bar Association has 
proposed amending the legislation to provide fiscal incentives for the 
courts to reduce or limit delays in foster care litigation and to improve 
^ ooo^''^l^' governing foster care cases (American Bar Association, 
1988). However, the federal agency, in commenting on a draft of this 
report, stated its belief that directing a portion of these funds to the 
court system would be a poor targeting of the scarce resources available 
tor improving the states' capacity to provide sei-vices to children and 
families. 



Achievement of 
Intended Objectives 



Data are not available forjudging whether unnecessary or inappropriate 
placements have been reduced or whether children and families are 
receiving more or more-appropriate services. Similarly, the sparse data 
available on improvement in steps taken to facilitate children's perma- 
nent placement cannot be solely attributed to the effects of these 
reforms. 



Most of the objectives defined in the section 427 requirements are proce- 
dural, such as determining the appropriateness and necessity of place- 
ment and services, rather than oriented toward obsei-vable outcomes for 
children and families. Other outcomes, either thosp that are specifically 
detined in the law or those that may be reasonably assumed, such as the 
child s proper care in placement, do not directly address hild and fam- 
ily behavior or welfare. This is primarily because the focus of our 
review is the section 427 provisions rather than the title IV-B grants or 
foster care-related services, more generally, which aim to promote the 
welfare of children. Therefore, following the structure of the evaluation 
framework, we address the long-term effects, such as reducing chil- 
dren s length of time in foster care and improving the well-being of fami- 
lies and children, under the criterion "other effects." 
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The statewide information systems required by section 427 do not 
include the qualitative data on placements and services necessary to 
address the issues of necessity and appropriateness of placements, nor 
would the national system recommended by the Advisory Committee on 
Adoption and Foster Care Information, The current state systems are 
only required by law to include data on a child's status, demographic 
characteristics, location, and placement goals. The additional items rec- 
ommended for the national system concern prior stays in care, duration 
of care, funding sources, and their biological and foster parents. 

None of this information directly addresses the necessity of placement 
or the appropriateness of the type of placement or services provided, , 
which must be determined in reference to each child's specific situation. 
The advisory committee recognized this limitation and recommended 
encouraging acyf to conduct special studies to complen?.ent the proposed 
national system. They suggested a follow-up study to collect in-depth 
information for individual children as the unit of analysis (rather than, 
as now, ser\^ices to them) and a feasibility study of a comprehensive 
child welfare information system that would include such issues as pre- 
vention services, administrative issues, and linkages with other .public 
service agencies where children are placed. 



Decrease in Placement 
Difficulties 

Necessity of Placements 



Inappropriate or Overly 
Restrictive Placements 



:RIC 



It is likely, .^ot verifiable, that regular external monitoring of agency 
decisions tc continue placement has reduced the proportion of children 
who remain in care unnecessarily. No available data directly addresses 
the difficult professional judgment implied by this outcome. Available 
measures, such as increased exit rates, shortened stays, and increases in 
prevented placements, might reflect an improvement in this area or, 
instead, inappropriate efforts to end or prevent placement. Other meas- 
ures, such as an increase in the number of children freed for adoption, 
might indicate improvements in determining the necessity of foster care 
placement. 

Indirect evider.ee suggests that the reforms may have reduced, but not 
eliminated, the number of inappropriately restrictive placements. 
Nationally, fewer children were placed in institutions in 1985 than in 
1977 (10 percent versus 14 percent), although the figures were stable — 
despite wide differences across states — between 1984 and 1985 for the 
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19 States reporting in both years (Maximus, 1988a). However the 
change cannot be confidently attributed to the reforms. Indeed, these 
figures may reflect not inappropriate placement but, rather, the need 
among some children m foster care for more supervision than is availa- 
ble m foster care families. 

The ^erican Civil Liberties Union (aclu) has provided direct evidence 
ttiat reviews alone have not eliminated this problem in at least one state 
TJrough analysis of Louisiana case reviewers' checklists in the mfd 

iXdVn fr"' '''' institutions were 
tSt there urmecessarily, according to the state's criteria. Addi- 
T^l'J found tha more than 10 percent of the state-supervised fos- 
ter homes exceeded the state's limitation on the number ofVhildren that 
can be m a particular home (Lowiy, 1988). However, it may be tha" 

ZZ^T '^"^^^ '^^'""^ instrumental in identifying 

these problems and, thus, effective in its short-term procedural 
objectives. 

Limited data suggest little improvement in meeting the requirement to 
ocate placements in close proximity to a parent's home. Only one state 
review board evaluation addressed this question, and it founZo slgnffi- 
cant difference between cases it reviewed and those it had not reviewed 
m the proportion of children placed within the county of their parent 
residencP (Nebraska State Foster Care Review Boardf 1986) Xo^^^^ 

rsti?ttt?:r ' S-"^ Pl-ed outside the county.in 
that state, the -eforms were apparently not effective in placing chi dren 

fTJt"'\ ^"^"^ ^ project'lnvolving are 

rwho h J ""^ '''' monitoring for older adolescents 

(who had already experienced several placements) showed large 
improvements in moving children out of institutions to placements with 
their own fam lies relatives, or foster families or to independent UvTng 
arrangements (Taber and Proch, 1987). P^'uenc uvmg 

f'f pi'pif experiencing several placements may indicate the inappropri- 
ateness of the match w.th a foster family or the absence of services to 
a1?1^ ^ ^^^«^"l«e« that may arise during a placement. 

Although one intensive project had good results, evidence of the success 
of more-typical implementation of the reforms is less promising. 

«^Pr7nt^^-^° '^■''^^ ^^"'"^ "»e^" """^ber of moves, 

after intensive case monitoring and services, was reduced from 4.8 to 

si'^fiSnn'"' intervention, placements were 

significantly more restrictive for older children. After the intervention 
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placements tended to become, instead, less restrictive over time or to 
end in family reunification. 

Evidence from state evaluations, however, is less promising. One state 
evaluation of a review board found no significant differences in the 
number of placements experienced by reviewed cases compared with 
those not reviewed by the board (but by some other review body) 
(Nebraska Foster Care Review Board, 1986). Moreover, both groups 
showed quite high numbers of placements (50 percent had four or more 
placements) compared with the vcis data for 1985, which reported that 
53 percent of children in foster care were in their first placement (Max- 
imus, 1988a). Similarly, another state that compared the effects of citi- 
zen participation in the review board found no effect on either the 
number or type of placements (Minnesota Department of Human Ser- 
vices, 1986). Yet, tiie Nebraska boara did find that the proportion of the 
entire caseload with four or more placements had declined from 31 per- 
cent 1986 to 27 percent in 1987. Available national data on change 
found these figures stable between 1984 and 1985 for the states that 
reported (Maximus, 1988a). 



The lack of data on the services provided to families is particularly dis- 
tressing, given the emphasis placed in the legislation on ascertaining the 
appropriateness, and ensuring the delivery, of needed services. We 
found no study that looked specifically at whether the reviews resulted 
in children and families' receiving more or more-appr ipriate services. 
Evaluations of special projects simply considered case monitoring and 
the provision of needed services as part of the undifferentiated treat- 
ment when exair.ining effects on length of stay and type of permanent 
placement achieved. 

However, indirect evidence suggests that case reviews alone have not 
ensured that needed services are provided, aclu testified that although 
Louisiana case reviewers had identified services that had not been pro- 
vided as ordered (for example, children in one third of the sampled 
cases had not had a physical exam in the last 12 months), little or noth- 
ing had been done to correct these omissions (Lowry, 1988). aclu was 
also the only source to report evidence of abuse in placement, claim- 
ing — from a review of a random sample of 25 Kansas City cases— that 
25 percent had been the subject of abuse or inappropriate punishment. 

The availability of agency funds for supplying basic necessities, such as 
housiUj 'nis been noted iii the descriptions of two projects considered 
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successful (Children's Defense Fund, 1988; Nelson et al., 1988) We 
could not establish, however, whether either study assessed the direct 
contribution of either these services to the reunification process or the 
reviews to the provision of these services. Moreover, it is surprising in 
light of the variety of reasons for placement that studies have not 
addressed whether the services provided are appropriate to the precipi- 
tating cause of family separation-for example, financial assistance for 
families separated because of inability to provide support or menta' 
health counseling for those charged with child abuse 



Facilitating Permanent 
Placement 



We found little information concerning whether case plans and review 
reforms have facilitated the permanent placement of children in foster 
care. Pnor to our examination of effects on length of stay, we examined 
a variety of process and outcome measures, such as setting placement 
goals and target dates for leaving foster care, increasing parental visita- 
tion, or termmating parental rights, where indicated. Data available on 
19 states show an increase from 47 percent to 55 percent between 1983 
and 1985 m the proportion of children with the goal of reunification and 
a corresponding decrease in the proportion with the goal of long-term 
foster care (22 percent to 19 percent) or with no goal (9 percent to 6 
percent) (Maximus, 1988a), but we cannot attribute this to the reforms 
rhe Maryland Citizen Board for Review of Foster Care of Children 
(1986a) reported that for 80 percent of the exiting children it reviewed 
the reason for exit matched the placement goal, presumably attesting to 
the success of the permanency planning process. 

Although many pre-1980 studies found that frequency of parental visit- 
ing was associated with shorter stays in foster care and a greater likeli- 
hood of returning home, we did not find any evaluations that addressed 
parental visitation. One state evaluation did, however, report that chil- 
dren whose cases were reviewed by the board, compared to some other 
entity, were 2.6 times more likely afterward to have had a parental 
rights termination filed or completed against their fathers, 3 5 times 
more likely against their mothers (Coyne, 1986). They were also more 
likely to have been relinquished for adoption by either their mothers or 
their fathers than were children whose cases had not been reviewed by 
the board. Although the cases the board reviewed may not have repre- 
sented the caseload, this finding suggests that the board's review may 
have facilitated placement for children unable to return home 
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Pncf fopti vpnPQQ identify any reliable studies of the cost-effectiveness of the 

UOSL-ililieCLlveiltJbb management reforms. This is partly because of the lack of reliable 

information on the effectiveness of the reforms, as discussed above, but 
also because of the meager quality of information on tne costs of imple- 
menting these reforms. For instance, although the additional reviews the 
legislation required were often claimed to be burdensome for both wel- 
fare agencies and the courts, we found no empirical analyses of the 
additional caseworker staff time costs created by the need to develop 
and update case plans and prepare materials for reviews and hearings. 

I'he additional time spent on case reviews raay be cost-effective if it 
yields substantial reductions in placement length. Some state reports 
provided per unit costs for foster care maintenance, institutional care, 
and some in-home services but dih'not provide the additional informa- 
tion needed to analyze cost-effectiveness. For example, estimates of the 
cost of home-based services per child ranged from $2,300 to $5,000, 
while estimates of foster care maintenance ranged from approximately 
$2,500 to $10,000 a year. However, it was not clear whether the reduc- 
tions in workers' caseloads (which have been claimed to be required in 
order to provide such services) were factored into these calculations, 
and neither service use nor effects data were provided. 

This type of data on cost per type of service was used in several 
instances to make cost-avoidance claims for the foster care review pro- 
cess. These cost avoidance **analyses" were frequently anecdotal, based 
on the hypothetical cost-savings associated with removing from place- 
ment a child who might have lingered in care for several years. Yet, the 
empirical data— such as studies demonstrating decreased entry rates or 
increased exit rates— did not include comparison bases that would per- 
mit attribution to the improved reviews and services (for example, 
Maryland Citizen Board for Review of Foster Care of Children, 1986a). 

The data we reviewed also do not recommend one type of review board 
composition as more cost-effective than another. Volunteer citizen 
reviewers may be less expensive than paid professionals but not neces- 
sarily more effective. The costs of operating citizen review boards were 
described in one article as limited to minor administrative and training 
expenses from the use of citizen volunteers. Another state estimated 
that citizen review boards would be less cost-effective because of the 
additional costs (not estimated) that would be incurred in creating a 
dnplicate case tracking system independent of the agency's (Minnesota 
Department of Human Services, 1986). That state also found no differ- 
ence in the number, type, or length of placements by the composition of 
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Long-Term Goals 



Length of Stay 



the board, whether it was made up of agency personnel or citizens How- 
ever, some concern was expressed by caseworkers, in at least one sur- 
vey, about the competence of citizen review board members 



Other Effects of 
Interest to the 
Congress 



Although the legisietion's goals and purposes are primarily procedural 
other goals surfaced in congressional discussions of the reforms or are ' 
implied by the procedural objectives. The data available do not permit 
us to attribute observed reductions in "foster care drift" (or the ten- 
dency of children to spend long, unintended periods of time in foster 
care), increased rates of family reunification, or reduction in the size of 
the caseload to the section 427 requirements. No direct information was 
tound on whether spending on services had increased relative to foster 
care mamtenance or on wliether-within the general purpose of the IV- 
B grants-the well-bemg of these children and families had improved. 

However, concerns have arisen about unintended side effects of the 
reforms, including whether children have been returned prematurely to 
abusive or neglecting families and whether state and local courts have 
been unfairly burdened by the imposition of federal requirements with- 
out compensation. Additionally, the reforms have served as standards 
guiding both state legislation and litigation brought by private parties to 
ensure the proper treatment of children in foster care 



Children s length of stay in foster care and the size of tbe foster care 
caseload have been reduced substantially, but it is not clear whether 
these reductions have been achieved through the procedural reforms. 

Nationally, laie median length of foster care stay has decreased dramati- 
cally since 1977, as has the percentage of the caseload with very long 
stays. Estimates of the median length of time in care for the caseload at 
?Q^flr" ^Tl^ decreased from 31 months in 1977 to 17 months in 
1985, and the proportion of cases that were in care 5 year's or more 
declined from 29 to 15 percent of the caseload (see figures 4.1 and 4 2) 
. he median length of stay in care for children who left care during 1985 
was 8 months, reflecting the greater representation"Hrchildren with 
snort stays in this measure than in caseload measures (Maximus, 
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Figure 4.1: Median Length of Time in 
Foster Care 1977-85 



40 Months in Care 




9/8212/82 9/83 



Source: Adapted from MaxirDus. Inc.. Chiid Welfare Chart Book 1 985 (Washington, 1988a). Data for 
1977 are from a 1977 survey, for 1980. from an HHb Office ot Uivil Hignts survey; for December 1982, 
from a Child Welfare Indicator survey; and for the remainder, from the Voluntary Cooperative Information 
System. 

These figures may not reliably estimate change because they were 
derived from different sources. The changes they show may not be 
attributable to implementing the procedural reforms, because the rate of 
decline began before 1980 (when the estimated median was 27 months) 
and other factors may be partially responsible. In addition, this reduc- 
tion seems to have leveled off since 1983 (see figure 4.1). Other vcis data 
show that rates of exit from foster care have been fairly stable since 
1982 (the earliest data available) at about 40 percent of the population 
in care (Maxim us, 1988a). 
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Source- Adapted (rom Maximus, Inc , Child WeKare Chart Book 1985 W.^hmninn pC 1988a) Data for 

Jl!'r!ZT .^^V"''^^' 1980, (rom an HHbOfdce of Cml Rights survV (or D^BcembJ 1982 
gm aChild welfare Indicator survey, and for the remainder, from the^oluntary Cooperatre WolS 

Although ' 982 was only the second year after the enactment of the 
reforms, a few states had previously implemented review systems simi- 
lar to those required by section 427, and 35 states had passed acyf's 
initial or subsequent review for fiscal year 1982. Therefore, it is possi- 
ble, but by no means conclusive, that the introduction of these reforms 
helped remove children unnecessarily remaining in foster care How- 
ever, m the absence of a systematic evaluation that rules out other con- 
tributors—such as noncomparable data or the simultaneous 
introduction of adoption assistance— we are not able to confidently 
attribute these changes to the section 427 reforms. 
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Several pre-1980 studies of special case management projects claimed to 
shorten placement stays and increase the rates of children exiting care 
(reviewed in Murray, 1984; in Rzepnicki and Stein, 1985; and in Seltzer 
and Bloksberg, 1987). But, once again, results from more typical imple- 
mentation have been less promising. One state review board discovered 
that the cases it reviewed were less likely to leave care than those it had 
not reviewed (Nebraska State Foster Care Review Board, 1986). In addi- 
tion, although that board reviewed only about a quarter of the caseload, 
the proportion of cases with long stays actually increased from 1986 to 
1987 (Nebraska State Foster Care Review Board, 1987). The author sug- 
gested two possible explanations for these findings: (1) the review 
board's sample was heavily weighted with children who had already 
been reviewed and not discharged to their fai ilies and (2) in sorae 
cases, citizen reviewers asked for additional services before returning a 
child home (Coyne, 1986). 

Both the Maryland and Delaware foster care review boards reported 
decreases in 1986 in lengths of stay over the past few years', accompa- 
nied, at least in Delaware, by a sharp increase in the proportion leaving 
within 1 year and a 50-percent decrease in the proportion staying more 
than 7.5 years (Davidson, 1986; Maryland Citizen Board for Review of 
Foster Care of Children, 1986a). However, these improvements cannot 
be confidently attributed to the section 427 reforms. In fact, since half 
the children entering care in Maryland exited within 6 months, they 
may not even have experienced the required 6-month periodic review. 

A study of administrative and service factors affecting the proportion of 
children in Wisconsin county caseloads who leave within 1 year of entry 
uncovered some interesting dynamics that may explain these contradic- 
tory findings (Sosin, 1986 and 1987), he -ounties' use of review boards 
to monitor decisions to continue care wa^ associated with more short 
stays, while the board's review of changes in placement or permanency 
goals was associated v/ith fewer short stays. This suggests that when 
the board disagrees with the caseworker's decision, when the 
caseworker recommends exit from care , the board's review may 
lengthen the child's stay. 

Sosin's study was unusual in that it attempted to identify the relative 
effectiveness of the different administrative and service components of 
agency practice. Caseworkers* discussions of a variety of topics with the 
biological family were associated with lengthier stays, apparently 
because these discussions tended to concern terminating parental rights. 
No characteristic of court reviews was found to be significantly related 
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to length Of Stay, perhaps, the author hypothesized, because the court's 
review was no more effective than the caseworkers' behavior in prepar- 
ation for it. Sosin also found that after controlling for these and other 
administrative requirements, providing parental supports such as res- 
pite care was not associated with shorter stays. It should be noted, how- 
ever, that many of the special projects considered successful tended to 
accompany case management procedures with intensive family services. 

There is some controversy in the literature about whether the case 
review and hearing requirements (particularly in combination with 
other 1980 reforms providing adoption assistance) have increased exits 
through increased family reunification or through other means. National 
data from vcis do not provide long-term information about tl.e outcomes 
for children exiting care but show little change in the destination of chil- 
dren leaving care between 1984 and 1985. In 1985, 66 percent of exiting 
children were recorded as having been reunited with their families or 
placed m the homes of relatives, 8 percent were adopted (down from 10 
percent in 1984), and 8 percent left through emancipation (Maximus, 
1 "883.). 

Two state foster care review board evaluations found that larger pro- 
portions of children they reviewed left care through adoption (19 per- 
cent versus 3 percent and 27-28 percent versus 13-15 percent) and 
through reaching the age of m^ority (12 percent versus 2 percent and 
20-22 percent versus 15-16 percent) than did children they had not 
reviewed (Maryland Citizen Board for Review of Foster Care of Chil- 
dren, 1986a; Coyne, 1986). This may help explain why children 
reviewed by such boards tended to have longer stays. Placement goal 
and length of stay are interdependent, partly because of the additional 
legal protections states impose on adoptions. Because of these protec- 
tions, as well as the difficulty in finding adoptive placements, it can take 
up to 5-1/2 years, on the average, between removing a child from home 
and i:iaking an adoptive placement final (Maryland Citizen Board for 
Review of Foster Care of Children, 1986). 

Other special studies have also shown increased exit rates achieved 
through higher rates of emancipation or adoption. However, very few of 
these studies include appropriate comparison groups that would permit 
attributing any causality to the review process. Several analysts in 
reviewing the literature published before and after 1980, have con- 
cluded that limited evidence suggests that permanency planning appears 
to have been successful in increasing the rate at which children are 



51 



Page 50 



GAO/PEMD-89.17 Implementation and Effects of Foster Care Reforms 



Chapter 4 

What Are the Effects of the Reforms? 



adopted but not reunified and, thus, may have its greatest effect on chil- 
dren who are unable to return home (Maluccio and Fein, 1985; Seltzer 
and Bloksberg, 1987). 

Caseload Reductions The reported size of the national caseload declined dramatically, from 

an estimated 502,000 in 1977 to 276,000 in 1985 (Maximus, 1988a), but 
other factors besides the reforms may be responsible,* Moreover, the 
greatest declines occurred before the enactment of the reforms, and, in 
recent years, caseload size has increased slightly (see table 4.2). Unpub- 
lished VGIS estimates for 1986 show an increase to 282,000 (Gall, 1989). 



Table 4.2: Estimates the ■H^^^^^^^^^HHHBMHB^^HHH^HH 

Nationa! Foster Care Caseload Year Caseload Source of estimate 



1977 


502,000 


Weslal, Inc. 


1978^ 


1979^ 


1980 


303,697 


HHS Office of Civil Rights 


1981^ 


1982 


279,886 


VCIS 


1983 


264.579 


VCIS 


1984 


274,141 


VCIS 


1985 


276.266 


VCIS 



'''No estimate available. 

Source: Adapted from Mark F Testa> Data Necessary to Support National Policy Functions in Foster 
Care and Adoption , technical appendix. Report ot the Advisory Committee on Adoption and Poster Care 
Information (Washington. D.C Administration (or Children, Youth, and Families. August 1987)! 



Several factors influence foster care caseload sizes and could be par- 
tially responsible for these reductions. One analyst suggested that the 
decline reflects the inflation of state estimates of caseload size, in that 
early period, by the presence of inactive cases that were subsequently 
purged in anticipation of the federal compliance reviews. Additionally, 
the size of the overall population of children and youths declined in the 
past decade. Finally, even if the reforms were facilitating permanent 
placements, caseloads might not be reduced. 

This is because caseload size is a dynamic function of both entry and 
exit rates. For example, the national caseload has increased slightly 
since 1982 (as it has for about half the states), primarily through 
increased entry rates into foster care (Maximus, 1988a). The increased 
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entry rates, in turn, are believed to reflect the documented increase in 
reports of child abuse and neglect in this period. Indeed, the proportion 
of children entering care for protective service reasons increased nation- 
ally from 58 to 61 percent between 1984 and 1985 (Maximus, 1988a). 

Services Versus Maintenance We found no direct information on state expenditures that would permit 

identifying whether spending on services has increased relative to 
spending on maintenance. However, indirect evidence suggests that it 
has. The administrative expenses reimbursed by the federal IV-E Foster 
Care program (which partially reimburses maintenance payments for 
children eligible for afdc in foster care) have increased tremendously, at 
a rate much higher than that of foster care maintenance payments, since 
1981 (U.S. Department of Health and Human Services, 1987). Although 
the costs of developing and reviewing case plans, for example, are 
defined as administrative expenses in the IV-E program, they are 
included as child welfare services in the IV-B program and, therefore, 
are not separately accounted for at the federal level, according to fed- 
eral agency offlcials. In 1987, the hhs inspector general identified 
increased claims for reimbursing service costs as one contributor to this 
increase in title IV-E administrative exp<inses but could not ascertain to 
what extent this increase reflected changes in actual service delivery or 
changes in state reimbursement accounting practices. Anecdotal evi- 
dence concerning the increase in home-based service programs suggests 
that the balance of expenditures may have changed in at least some 
areas of the countiy. 

Child Weil-Being We found no evaluations of the effect of the state reforms on improve- 

ment of children's physical, educational, psychological, or emotional 
growth and development in foster care. One comprehensive search of 
the literature on permanency planning from I960 to 1983 found "no 
study ... in which the health and safety of the child was the primary 
outcome examined" (Seltzer and Bloksberg, 1987, p. 66). Using a variety 
of measures of adjustment, the authors also concluded that -nost pre- 
1980 research found no difference in psychological acUustment between 
children who were placed in homes intended to be permanent and those 
who remained in "temporaiy" placement. Other studies found no differ- 
ence in later adult functioning between children in foster care and their 
peers who remained in homes that had contact with the child welfare 
agency. 
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Unintended Side Effects 

Return to Foster Care Limited evidence has raised the concern that the rush to move children 

into permanent placement may have resulted in inappropriate place- 
ments. This literature suggests that at least for the short time periods 
studied, adoptions tend to be more stable than family reunifications 
Three special projects and research studies reported 0 to 2 percent of 
adoptions disrupted within 6 to 16 months, while 9 to 3/ percent of the 
children reunited with families returned to care within I j n^onths (see 
Rzepnicki, 1987). 

Using a different measure, m aCyf analysis of the number of reentries 
among new entries to care found reentry rates varied between 0.07 and 
0.56 in the 18 states reporting in 1983 (Gershenson, 1986a). While addi- 
tional information was not available to analyze whether the higher reen- 
try rates reflected greater agency, family, or ecological (for example, 
financial) problems, these rates were believed to be related to the states* 
rates of family reunification. The author suggested that the higher reen- 
try rates may reflect agencies' use of a higher-risk strategy than states 
having lower family reunification rates. However, the validity of this 
claim is questionable because (1) dramatic changes in these rates were 
observed for several states over a year and (2) the reentry rates reflect 
not only placement disruptions but also the rates of new referrals to 
foster care. 

A few studies investigating recidivism have suggested that lack of after- 
care services is to blame. Turner (1984a) found that families that 
remained reunited had received more months of case management and 
more social services upon reunification. Other literature reviews have 
noted the importance of combining services and case management for 
success in preventive preplacement programs (see Nelson et al., 1988). 
In an analysis of Baltimore's higher-than-average reentry rates (one 
fourth versus one eighth of entries), those who returned were found to 
have had substantially shorter-than-usual stays in foster care (1 1 ver- 
sus 20 montbo, fo ^ those returned to their families). The reviovvers 
hypi thesized that the absence of aftercare services for children with 
very short stays may havo been responsible for their higher recidivism 
(Maryland Citizen Board for Review of Foster Care of Children, 1986a). 



Effects on State Couits Requiring periodic case reviews and dispositional hearings and specify- 

ing how they are to be held has undoubtedly increased the responsibili- 
ties of the state court systems, as we!' as state child welfare agencies. 
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Depending on previous practice, these requirements may also have 
increased their workloads. Although aba has claimed that the federal 
requirements have increased court workloads, it is the states that have 
generally opted for a judicial 6-month review, as the federal legislation 
IS flexible about where these reviews may be held. Similarly, the states 
are free to set the periodicity of the dispositional hearings subsequent to 
the first hearing, which federal law requires be held 18 months after a 
child is placed in foster care. While increased procedural complexity can 
be considered an integral part of the intended safeguards for the rights 
of parents and children, the resulting strain on the courts' resources 
may not have been foreseen. 

The federal requirements also have served to set a standard for state 
prrctice and have created a basis for private enforcement of the law 
that is recognized in certain courts. The U.S. Courts of Appeals for the 
First and Fourth Circuits have concluded that section 427 may be 
enforced by private right of action ( Lynch v. Dukakis . 719 F.2nd 504 
(1st Cir. 1933); L. J., An Infant v. Massinga , 838 F.2nd 118 (4th Cir 
1988) cert;, denied, 109 S. Ct. 816 (1989)). The U.S. Court; of Appeals for 
the Sixth Circuit and certain other lower courts have concluded, how- 
ever, that section 427 does not authorize a private right of action 
(Lesherv. Lavrich. 784 F.2nd 193 (6th Cir. 1986); In re Scott County 
Master Docket , 672 F. Supp. 1 152 (D. Minn. 1987); lETTCynthi a A 514 
A.2nd 360 (App. Conn. 1986)). Thu% one result of section 427 hiTbeen 
that an additional avenue for monitoring agency handling of foster care 
placements is available in cert;ain courts. The availability of this remedy 
m other federal and state courts is uncertain and will depend upon deci- 
sions rendered by those courts in the future. 
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Although procedural protections have generally been instituted, present 
conditions suggest a continuing need for incentives to fully implement 
the reforms, perhaps with additional efforts to strengthen them. Prob- 
lems continue in foster care placement — such as lengthy stays and mul- 
tiple placements — that may require at least monitoring and vigorous 
services to resolve. For example, of the over 276,000 children in foster 
care at the end of 1985, 15 percent had been there at least 5 years. 

Some of the problems identified have been linked with negative conse- 
quences for children. In addition, changes since 1980 in reports of child 
abuse and neglect, drug use, and homelessness, increasing the number of 
children at risk, have raised the demand for foster care and family ser- 
vices. Despite sizable contributions from private sources, federal legisla- 
tive and fiscal incentives are apparently still needed to bring about 
improvements in the deliverj^ of services to children *^r.i their families. 
Table 5.1 summarizes our findings on each indicator of the need criteria. 



Table 5.1: Continued Need for the Feclaral Incentives for Refonn 


Criterion 


Indicator 


Finding 


Problem magnitude 


Procedural problems 


The quality of case planning and monitoring is questionable; 
medical, dental, and mental health services are claimed 
insufficient 




Placement problems 


One fourth of children in care had been there at least 3 
years; 21% had 3-5 different placements 




Increased demand 


Increases in drug use, births to unmarried teenagers, and 
homelessness may contribute to increased demand for 
services 


Problen) seriousness 


Consequences of procedural problems 


Case planning and monitonng of questionable quality may 
increase length of stay in care 




Consequences of placement problems 


Longer stays may inhibit reunification efforts 


Duplication 


Alternative resources 


Private funds attempt to enhance, not duplicate, federal 
and state funds, through funding innovative approaches 
and strategies 




Alternative protections 


Federal law provides protections not in all state laws and 
extends them to all foster care cases 



Prnhlpm Mp^nitilHp Available evidence suggests that pn/olems remain in the management of 
riUUlt^m ividgllltuuc ^^^^^ ^^^^ ^^^^ example, 25 percent of the children in care in 1985 

either had no placement goal specified or had long-term foster care as a 
placement goal; 27 percent had been in care at least 3 years; 21 percent 
had three to five different foster care placemen t!s (Maximus, 1988a). A 
study in one county found that fewer than half the cases reviewed 
received regular medical and dental care (Mushlin et al., 1986). Further, 
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the demand for services appears to have increased in recent yeare, 
although reliable estimates of the magnitude of that change are 
unavailable. 

Representative national surveys and reliable empirical studies that 
report present conditions in the child welfare system are, at best, scarce. 
The interpretation of reported conditions is further complicated by the 
lack of standards or outcome objectives (for example, how long in care is 
"too long"?) specific to the IV-B program. Section 471 of the Social 
Security Act (as added by the 1980 act) requires states participating in 
the title IV-E Foster Care program to establish numeric goals regarding 
the number of children who will remain in care longer than 24 months. 
We must note, however, that other concerns may have taken precedence 
over the promulgation of specific outcome goals that may not be attaina- 
ble or useful for state and local agencies (Forsythe, 1989). 

Problems have been cited that can generally be characterised as (1) pro- 
cedural, or problems in the management of foster care cases; (2) place- 
ment difficulties, or problems with conditions of the placement; and (3) 
increased demand for services. 



Procedural Difficulties 



Quality of Case Plans and 
Supervision 
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Difficulties cited in the management of foster care cases include but are 
not necessarily limited to (1) the quality or appropriateness of case 
plans; (2) the suitability of foster homes; and (3) caseworkers' contact 
with the natural parents— a general ind=cator of case monitoring and 
reunification efforts. 

Despite the emphasis on permanency planning, 1985 vcis data iniicate 
that 6 percent of cases had no goal specified, while another 19 percent 
had long-term foster care as a case goal (Maximus, 1988a). While we 
acknowledge that more-permanent plans may not be desirable in all 
cases, these figures .seem to speak to the need for periodic review. An 
ACLU case filed on behalf of foster care children in one county in Mis- 
souri reported that only 9 percent of a small but random sample of cases 
had adoption as a case plan, and most of the children in those cases (89 
percent) were younger than 6 (Mushlin et al., 1986).' This implies that 
adoption may not be as frequently planned for older children, those gen- 
erally considered among the most difficult to place. 
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The suitability of the homes in which children are placed may also be a 
concern. A foster home may be deemed unsuitable if the foster parents 
have a known history of abuse or neglect, if placement in the home rep- 
resents a danger to :he child, if the foster parents fail to provide essen- 
tial care for a child, or if the foster family is known to lack the skills 
required to care for a particular child. Using these criteria, Mushlin et 
al. (1986) found over 40 percent of the Missouri cases sampled were in 
"unsuitable" homes. 



The monitoring of cases once a child is placed may also be problematic, 
at least as evidenced by reports of the frequency of caseworker-family 
contacts. For example, a study commissioned by acyf shortly after the 
1980 reforms were implemented reported a high frequency (three or 
more limes per month) of casev/orker-family contact in only 23 percent 
of the cases (Yoshikami et al., 1984).- Twenty-seven percent of families 
met with the worker less than once a month. Further, families receiving 
reunification services were generally not happy with their caseworkers. 
The ACLU case discussed above indicated that in 77 percent of the cases 
reviewed, there was no record of the caseworker's contacting the biolog- 
ical parents within the past year. Fewer than 30 percent of the cases 
had any written agreement with the parents regarding the services 
planned (Mushlin et al,, 1986). 

Addressing Health and Available information regarding the adequacy with which children's 

Educational Needs health and educational needs are being addressed suggests a need for 

improved services. A screening of children entering foster care in Cook 
County, Illinois (which includes Chicago), during 1 month in 1984 found 
that 87 percent had some physical problem. Reportedly, half those with 
difficulties were found to have multiple problems, the most frequent dif- 
ficulties involving physical growth, development, behavior, and the skin 
(Ilochstadt et al,, 1987). Mushlin, Levitt, and Anderson (1986) reported 
that many lacked medical records, and 59 percent of the case files they 
reviewed lacked evidence of recent medical examinations. Eighty-seven 
percent lacked indications of recent dental examinations. The House 
Select Committee on Children, Youth, and Families reports that the early 
periodic screening, diagnosis, and treatment exam was completed for 
only 30 percent of newly enrolled cases and only 18 percent of long-term 
foster care cases in one major city (U.S. Congress, 1988b). 
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It also appears that children entering foster care bring educational defi- 
ciencies that may not be addressed while they are in care. A 1977 com- 
parative analysis showed that while 80 percent of children nationwide 
were at their modal or age-appropriate grade level, only 69 percent of 
the children receiving child welfare services at home and 59 percent of 
those in foster care were at modal grade (Gershenson, 1986b). Seventy- 
three percent of the 6-year-olds in foster care were in first grade, com- 
pared with 93 percent nationally. Thirty-two percent of 17-year-olds in 
foster care and 27 percent of those in home care were in the 12th grade, 
compared with 70 percent nationally. The author concluded that these 
data suggested that the educational deficiencies of foster care children 
existed prior to their entry into the program and that improvements 
were only marginal. 

Later studies also suggest the continued educational deficiencies of fos- 
ter care children, although post-1985 reviews oh this issue were unavail- 
able. Of the children entering foster care in Cock County, Illinois, during 
1 month of 1984, one third of those eligible for school had not yet been 
enrolled or were thought to require some type of special educational ser- 
vice (Hochstadt et al., 1987). While lot claiming currency or the ability 
to generalize nationally, these data do suggest conditions that may not 
have improved substantially after the 1980 reforms. 

Other Services Lacking Our review also identified the following areas among those in which 

more services are claimed to be needed but with no specific estimates of 
the shortfall: 

• services to address the behavioral or emotional problems of childrei 
foster care. Studies indicate that in some cases, workers were aware o; 
reported difficulties but did not (or could not) provide the needed ser- 
vices (Besharov, 1986; Mushlin, Levitt, and Anderson, 1986). 

• services to help prepare youths for self-sufficiency who are soon to 
leave the system by virtue of age ("emancipation") (Maluccio and Fein, 
1985). 



Placement Difficulties 

Lengthy Stays in Foster Care Foster care is intended to provide temporary shelter for dependent chil- 
dren, as evidenced by the requirements of section 471 of the Social 
Security Act. Data from the Voluntary Cooperative Inforn.ation System, 
however, indicate that in 1985 at least 27 percent of the more than 
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276,000 children in foster care — that is, about 74,000 chiluren— had 
been there 3 or more years. Fifteen percent, or about 41,800 children, 
had been there for 5 or more years (Maximus, 1988a). These estimates, 
like most found in the literature, are based upon samples of children in 
care at a fixed point in time. Estimates based on samples of children 
entering care over a period of time tend to generate lower estimates of 
length of stay because of the substantial number of children who were 
in care for less than 1 year and therefore not available for assessment 
by a once-a-year censuc, for example. These and other differences com- 
plicate the interpretation of such data.^ 

Multiple Placements vcis reports that in 1985, 50 percent of the children in foster care expe- 

rienced at least two placements; 21 percent had three to five different 
placements; 6 percent had six or more placements (Maximus, 1988a). 
For some of these children, their first placement may be brief — made in 
an emergency — while a more permanent foster home is located. In gen- 
eral, older children seem to be more likely to be shifted through a 
number of foster homeij (Besharov, 1986), although this finding may be 
confounded with their longer tenure m care. 

Restrictiveness of Placements A review of the statutes of 19 states that reportedly encompassed 75 

percent of the foster care population at the time of the review concluded 
that those 19 states were not complying with the least restrictive, most 
family-like setting requirement outlined in section 475 (Proch and How- 
ard, 1984). Analyses based upon individual case reviews corroborate 
this conclusion. In a survey of 18 agencies across 5 states, Yoshikami et 
al. (19^4) reported that 32 percent of sampled cases were more than a 
30-minute drive from the biological parents. This survey reported fur- 
ther that only 40 percent of the children placed had known or met the 
substitute caregiver prior to the placement. In 70 percent of the cases 
sampled, some obstacles to parent-child visiting existed. One state 
reported that 68 percent of the children were placed in same or a 
neighboring county, another 19 percent being placed in counties further 
from home or in another state. Distance from home was unknown for 13 
percent of the cases (Nebraska State Fc / Oare Review Board, 1986). 

Frequency of Parental Contact We found few studies that reported the jquencj of parental contact 

with children placed in foster care and none that were recent or 
appeared to be nationally representative. In a 5-state study, Yoshikami 
et al. (1984) reported that 38 percent of cases showed frequent parent- 
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induding it in aggregate statistics (Gershenson, 1987). 
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child visiting (three or more times per month), 32 percent showed par- 
ent-child visits with moderate frequency (one or two times per month), 
29 percent having contact with parents less than once a month (low fre- 
quency). We were unable to determine whether tnese findings could be 
generalized to present conditions in foster care placements. 



Increased Demand for Beyond the difficulties w.chin the system noted above, external pres- 

Foster Care Placements ^"^^^ appear to place additional burdens on the system (Massinga, 

1988). Changes that have emerged since 1980 have resulted in increases 
in the number of families requiring services, including increased report- 
ing of child abuse and neglect, greater numbers of families in poverty- 
many of whom are homeless— and increased substance abuse (Chil- 
dren's Defense Fund, 1988). 

A 1987 House Select Committee on Children, Youth, and Families survey 
shows increases in reported child abuse and neglect between 1981 and 
1985 in all but 1 state that reported. Although aspects of the survey's 
methodology have been questioned, other reports supported this conclu- 
sion, vcis data show that the number of cases entering foster care for 
protective services increased from 58 to 61 percent between 1984 and 
1985 (Ma- "mus, 1988a). 

With recent increases in the number of infants born to unmarried teen- 
age mothers, more children are at nsk of growing up in poverty (gag, 
1986). Families may also find themselves in poverty for a number of 
other reasons. For some families, these financial difficulties may result 
in homelessness. As the homeless population grows, so does the number 
of children for whom parents and advocates may seek foster placement 
as a means, perhaps temporarily, of meeting these children's needs (Wil- 
liam T. Grarit Foundation, 1S38). 

Increases in substance abuse have also contributed to the number of 
children requiring foster care placement (William T. Grant Foundation, 
1988). Testimony before the House Select Committee on Children, 
Youth, and Families claimed that 70 to 80 percent of children entering 
placement have some history of drug use in their family (Olson, 1988; 
Ha man, 1988). In New York City, parental drug use has been cited as 
the ost common allegation in abuse and neglect petitions (McLaughlin, 
1988). At the end of February 1987, as many as 300 infants medically 
ready for discharge remained in hospitals awaiting placements in New 
York City. These "boarder babies" were the offspring of drug-addicted 
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mothers who were unable to care for them (Children *s Defense Fund; 
1988). 



Studies identified no more than descriptive associations betweon various 
procedural problems and service inadequacies noted above and certain 
characteristics of children's placements. In the absence of more empiri- 
cally sound, longitudinal studies targeted toward these issues, causality 
cannot be clearly attributed. 



(vOnsequences Linked With ^^^^ planning is believed to contribute to lengthy stays, primarily 
Procedural Difficulties basis of pre-1980 studies of special case management projects 

(Sosin, 1987). Poor planning has also been claimed to contribute to 

higher recidivism rates (Rzepnicki, 1987). 

Poor or inadequate supervision of placements has been cited as contrib- 
uting to less frequent parental contact (Hess, 1987) and longer stays in 
foster care (Sosin, 1987). Higher recidivism rates have also been 
reported in cases of unplanned discharges, or situations in which a child 
is removed from foster care by the par'ints, courts, or child welfare 
agency (Block and Libowitz, 1983). Poor case monitoring may also con- 
tribute to the discharge of older children without adequate preparation. 
The number of placements a child experiences has been linked with the 
failure to deliver required or intended services, especially for older chil- 
dren (Besharov, 1986). 

However, to fully evaluate the child welfare services program, further 
research is necessary on the effect of the quality of case plans and 
supervision on outcomes for children, including maintaining parental 
contact, the number of different placements and other placement diffi- 
culties a child experiences, and progress toward permanent placements. 

Sources that investigate the purported effect of the inadequate availa- 
bility of health and educational services for children in foster care and 
their families are rare. It would be helpful if future investigations would 
explore the relationship between reports of abuse and neglect and psy- 
chological maladjustment and the paucity of health and educational ser- 
vices in a given community, county, or state. 



Problem Seriousness 
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-Tt Should not be assumed that all foster care experiences are damaging 
or that lengthy stays in and of themselves hold negative consequences 
for children (Seltzer and Bloksberg, 1987). One advocate claimed that 
former foster care children populate our mental hospitals, jails, and wel- 
fare rolls as adults (Lowry, 1986). However, Barth (1987) reports that 
there are no significant differences between former long-term fa ster 
care children and the nonfoster care population in marriage, divorce, 
incarceration, parenthood, and marital satisfaction later A review of 
the notable pre-1980 literature found no significant differences in psy- 
chological adjustment between children placed in homes intended to be 
permanent and those who re" lained in temporary placements (Seltzer 
and Bloksberg, 1987). However, procedural difficulties that frequently 
emerge during lengthy stays in substitute care have been linked with a 
number of negative consequences. 

Studies indicate that the longer a child is in placement, the less contact 
with the biological parents the child is likely to have, which may dimin- 
ish future chances for successful reunification (Gibson, Tracy, and 
DeBord, 1984; Hess, 1987). Further, the longer children are in place- 
ment, the greater chance they have of being moved from one foster 
home to another. Lengthy stays may also increase the probability of 
caseworker turnover (Mushlin, Levin, and Anderson, 1986). Runyan and 
Gould (1985) suggested that the number of diffeiont placements a child 
experiences is positively correlated with later criminality. However, 
because of the lack of experimental controls, these results could also be 
accounted for by the behavioral difficulties of children in long-term 
care. 

No sources have been identified that investigate the effects of overly 
restrictive placements.on children in foster care. While it would seem 
that restrictive placements would lend to decrease parental contact and 
increase lengths of stay in care, no available sources have investigated 
these relationships. 



Duplication ^'^^^ existing federal and state laws may not be sufficient to ensure 

that the reforms discussed above continue to be applied. While some 
states have incorporated them into law, federal efforts may still be 
needeo to enforce adherence to policies and procedures. 



Consequences Resulting 
From Placement 
Difficulties 
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Beyond the impetus to reform provided by the 1980 act, the fiscal 
aspects of the title IV-B funding structure are important for the future 
of child w rare services. Although this is not the only source of support 
for these services, alternative sources do not appear sufficient to satisfy 
the demands of the system. 

Funding for social service block grants — reportedly the largest source of 
funding for child protective and child welfare services — was cut in the 
Omnibus Budget Reconciliation Act of 1981 (U.S. Congress, 1987). The 
fiscal year 1988 block grants appropriation was $2.7 billion, less (even 
without adjusting for inflation) than the fiscal year 1981 appropriation 
of $2.9 billion. Further, many other social service programs are funded 
by these grants. It has been estimated that less than 20 percent of these 
funds are spent on protective services for children (U.S. Congress, 
1988a; gao, 1988). 

Evidence suggests that while some services are provided to families in 
programs funded by private or charitable organizations, these efforts 
are generally intended to supplement or enhance, not replace, federal 
support. Officials of two of the major sources of private foundation sup- 
port in this area indicated that they try to support innovative tech- 
niques or approaches to child protection with their grants. Further, once 
programming is under way, grantees may be expected to take over the 
financial support or find alternative funding sources (Harper, 1986). For 
example, the Edna McConnell Clark Foundation reported spending $4 
million, more than 20 percent of its 1988 awards, on public law 96-272- 
related programming; the Annie E. Casey Foundation reported spending 
$5 million. However, these sources alone cannot and are not intended to 
fully address the needs of foster care children and their families. 



Availability and Adequacy Although the federal legislation followed some state and local efforts 
of Other Protections chapter 3), the 1980 federal reforms implemented general stan- 

dards toward which all states could strive. Others have cited the federal 
reforms as having provided the support necessary for child advocates to 
demand services and conditions important for the adequate care of chil- 
dren in placement (Lowry, 1986). 

Further, the reforms extended foster care protections to all children in 
placement. While the title IV-E Foster Care program also requires the 
section 427 and other protections, that program applies only to children 
who are eligible for afdc, only about 37 percent of the children in foster 



Availability and Adequacy 
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care (U.S. Congress, 1988a). Section 427 extends these protections to 
children in foster care not eligible for afdc. 
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The Adoption Assistance and Child Welfare Act of 1980 requires the 
states to implement all 18 elements of the case review system specified 
in the law before qualifying for-any incentive funds, and Hiis must 
enforce these requirements. Despite our previous recommendation that 
mis amend its ceriification process (gag, 1984), iiiis continues to provide 
incentive funds to states that it has determined have not completely met 
these requirements. Almost all the states have instituted policies and 
procedures to meet the requirements of section 427, but many are still 
not consistently applying all the required protections. In particular, we 
believe that permitting states to omit elements of the required protec- 
tions to a case, beyond a stated tolerance, is not consistent with the law. 
Moreover, certifying states as eligible when they are not reduces the 
incentive for the states to improve their performance toward complete 
compliance with the law. 

A national data collection system, such as the one recommended by the 
Advisory Committee on Adoption and Foster Care Information, would 
offer a great improvement over the current voluntary system, and nns 
should proceed immediately with its development, as required by law. 
Given the findings of our review, demonstrating the general inadequacy 
of data in the current voluntary data system for identifying problem 
magnitude and program achievements, timely progress in the develop- 
ment of a national information system is essential for sound policymak- 
ing. On May 26, 1989, the secretary's mandatory report (due July 1, 
1988) responding to the advisory committee's report proposing such a 
system was delivered to the Congress. The department, in commenting 
on a draft of our report, noted that a draft notice of proposed rulemak- 
ing (due December 31, 1988) is in the final stages of preparation. 

The absence of reliable information about whether the procedural 
requirements in section 427 have improved the delivery of services and, 
therefore, the cost-effectiveness of the program raises unanswerable 
questions about the merits of expanding program resources. The limited 
evidence available suggests — but is not of sufficiently high quality to 
conclude — that the incentive funds have been effective in reforming 
state practice and that the reforms may have improved the treatment of 
children in foster care. It is not known, however, whether the reforms 
have improved the appropriateness of placements and services deliv- 
ered to these children and their families or whether they have promoted 
the ultimate goals of these grants to promote and protect the welfare of 
children. 
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Recommendations to 
the Secretary of 
Health and Human 
Services 



We recommend that the secretary reexamine the department's stan- 
dards for certifying states' compliance with the section 427 require- 
ments to ensure that receipt of incentive funds is contingent, from 1989 
onward, on the states' meeting all the law's requirements. In particular 
we recommend requiring the states to demonstrate the implementation' 
of all the required elements of the case review system. 

We further recommend that the secretary promptly comply with the leg- 
islative m-'tidates of Public Law 99-509 regarding the development of an 
adoption a^ foster caivi information system. 



Matter for 

Consideration by the 
Congress 



The Congress may want to consider funding additional information 
development to improve the knowledge base about how case monitoring 
and delivery of services can best promote the goals of the Child Welfare 
Services grants in total. Specifically, it might be more desirable to target 
any additional money for the federal agency to conduct sound evalua- 
tions of promising state and local programs and to disseminate the guid- 
ance resulting from those evaluations to the states. 



Agency Comments and ^ '^^ Department of Ilealth and Human Sei-vices provided written com- 

Our Evahlfltinn °" ^ ^'"^^^ °^ ''^^^''^ (^'^^^ reproduced in appendix VII). 

O'Auauuu I he agency commended the objectivity and thoroughness of the report 

and concurred with our recommendations to enforce state documenta- 
tion of the protections required by section 427 and to comply with the 
mandates regarding the development of a national foster care and adop- 
tion information system. 

The agency did not concur with a proposed recommendation to author- 
r/.e the states to transfer a portion of the section 427 funds to the state 
courts or with our conclusions about the effects of these reforms, 
i^^'' the courts are not required to conduct the periodic reviews and 
b- . the additional burden claimed for the federal requirements has 
neither been demonstrated nor quantified, we no longer propose that 
recommendation. We acknowledge that concerns about targeting the use 
of the title IV-I3 funds for providing child welfare services may override 
concerns about targeting the incentives for emsuring the protections. 

IIII.S expressed the opinion that we have understated the effect of the 
reforms on improvements in state child welfare systems because we 
have not acknowledged the anticipatory effects in the states that imple- 
mented the reforms prior to the passfx'e of the 1980 act. However, the 
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timing of the reforms' enactment compared with the onset of the 
observed changes is not the only reason uhy we believe that reductions 
in national caseload size and length of stay, in particular, cannot be con- 
fidently attributed to the reforms. First, because of the differences over 
time i data collection, the changes may not have been accurately esti- 
mated. Second, comprehensive evaluations have not been conducted 
that could rule out alternative explanations for the changes observed, 
such as the simultaneous introduction of adoption assistance in the 1980 
reforms. In addition, caseload size and the number, or proportion, of 
••uldren in institutional foster placement are complex indicators, 
changes in which may reflect a number of other influences, such as che 
volume and character of the population entering foster care, in addition 
to the effects of the procedural refonns. We have altered the text to ' 
clarify this issue. 

HUB also noted that in several places in the draft we incorrectly st:;ted 
that the agency does not require the states to include all 18 protections 
in order to receive incentive funds. We intended these statements to 
refer to nns's case record compliance review standards and have altered 
the text accordingly. We believe that not requiring a case to demonstrate 
all 18 protections is not as insignificant as the agency has portrayed it 
by characterizing this as **a tolerance level only." While we acknowledge 
that the secretary may apply a tolerance level in judging vhc states' com- 
pliance, the current complianco review procedures contain two separate 
tolerances. Each case may omi^ up r 1 of the 18 protections (in the tri- 
ennial review), and 10 percent of the sampled cases may fail that stand- 
ard or be missing a case plan or timely periodic review ox dispositional 
hearing. When combined, these tolerances could permit the certification 
,of state ^ ompliance in a situation in which no sampled case actually met 
the full requirements of the law. 

Other technical comments from mis have been incorporated in the final 
report. 
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The Honorable Charles Bowsher 

Comptroller General 

U.S. General Accounting Office 

441 G Sr., N.V/. 

Wasfiingron, D.C. 20548 



Dear Mr. Bowsher: 

The Select Committee on Children, Youth and Families is concerned 
with the operation, effectiveness and cost-effectiveness of over 70 
federal programs targeted at children, youth and their families. 
These programs include income security programs such as Aid to 
Families with Dependent Children (AFDC), social services pr/^'^rams, 
such as those focused op , run -away youth, preschool education 
programs such as fteadsta.h, and basic needs programs such as the 
Special Supplemental Program for Women, Infants and Children (WIC). 
As is obvious, each. of these: programs is intended to serve 
potentially different segments of the U.S. citizenry. Each hai> 
different goals and objectives, making comparison difficult. 

As part of the Select Committee*s previous efforts, we have reviewed 
available evidence on these programs and have commissioned reviews 
of some of these programs. I am struck by the diversity of criteri;- 
that have been used in these reviews to evaluate effectiveness and 
efficiency of the programs under our jurisdiction. This raises 
seve-il questions about the types of criteria that could be employed 
in making these determinations. What appears to be missing at this 
time is a broad framework for examining evidence across programs. 

In pursuing this issue, my staff have had several conversations with 
members of your Program Evaluation and Methodology Division (PE^ffi). 
Those discussions have suggested several promising approaches, 
pierefore, I would like ro request that your staff within PEN© 
develop, if possible, a general framework for assessing the relative 
merits of federal programs and the various components of these 
programs concerned with children, youth and families. In 
particular, I would like PEMD to address the following questions: 



1. What criteria have been employed to assess the effect i »• :ness of 
relevant federal programs? 

2. WImt are the strengths and limitations of employing these 
criteria? k / s 
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3. IVhat- criteria mlghr be used ro gain a more comprehensive 
understanding of rhe operations, efficiency and effectiveness of 
current relevant federal programs? 

4. What factors should be considered to assure that comparisons 
across programs are fair and accurate? 



Further, to gain a sense of the applicability of the framework thar 
is developed, it would be helpful if the framework was applied to a 
particular policy area, I would like to suggest that your staff 
collaborate uUh Mr, Souder (Minority S^aff Director) and Dr, 
Statuto (Minority Deputy Staff Director) in >lecting the particular 
policy area, 

labile I am extrenely interested ii. answers to these questions and 
the results of the case illu tratJon, I realize thai undertaking 
such an assignment is a major ef for? . However, I would hope that 
PBfl) would initiative the work as soon as, possible, but no later 
than Spring 1987, and that once the study is initiated, we could 
receive a briefing on the work plan. In addition, I would like to 
receive a briefing on the framework that is developed and the full 
report as soon as that is feasible, I request rhat a^O deliver the 
report ro me at rhe same time it is sent to the agency (or agencies) 
for comment. I also request rhat GAO not release the report for 50 
days after publicaMv*'^, or until I release the report. 

ThTink you in advance for your cooperation. I look forward to 
working with your staff- 
Sincerely, 




\)^ } Coats 

Ranking Minority y^imber 
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Follow -Up to Request 



February 17, 1988 



GAO 



United States 

General Accounting OfTSce 

Washington, D.C 20548 



Program Evaluation and 
MethodoIog>' dision 



The Honorable Dan Coats 
Ranking Minority Meriber 
Select Committee on Ctiildren, 

Youth and Families 
House of Represen.tatives 

Dear Mr. Coats: 

Your letter of December 18, 1986 requested that we develop a 
framework for assessing the relative merits of federal 
prograiAS concerned with children, youth and families. You 
asked that we assess the strengths and limitations of 
criteria previously ^ployed to assess these programs, to 
identify criteria that r.ight be employed as well as factors 
that should be considered to assure fair and accurate 
comparisons across programs. Finally, you requested that we 
apply that framework to a pa*:ticular program area, to be 
selected in collaboration with your staff. 

After conducting a preliminary revitt' of existing evaluation 
literature and developing both a framework and a plan for 
our study to test that framework, we met with your staff to 
discuss our work to date and our planned approach to 
addressing your questions, in the course of those 
discussions, your staff indicated their desire that we not 
pursue further the effort to identify methods for comparing 
programs using our framework, and that we provide instead 
additional illustrations of how our framework can be ui;ed« 
We agreed to alter the scope of the study in this manner. 
T^e purpose of this letter is to confirm the agreements 
reached during these discussions. 

1. Our top priority assignment will be to illustrate 
application of the framework to five program;? in all, 
instead of one. First, for all five of these programs, we 
will show how the framework can encompass the major 
substantive issues of a variety of programs. The pre uct 
will be a listing for each program of its specific 
substantive issues, clustered by the general criteria of our 
framework. The five 'programs' selected for this form of 
application are: (1) the Supplemental ^ood Program for 
Women, Infants and Children (WIC), (2) the Head Start 
program, (3) the Juvenile Justice grants L r delinquency 
prevention and treatment (excluding projects aimed at 
runaway, homeless or missing children), (4) the extension of 
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federal Medicaid eligibility to children and pregnant women 
not otherwise eligible through the Al'DC and SSI programs, 
and (5) the Child Welfare Services grants* 

On or about: June 15, we will brief the Committee on the 
results of these applications and provide the issue lists 
and the evaluation framework in the form c£ fact sheets, 

1. e. , excluding any "^indings, conclusions, or 
recommendations* In the interests of tim(:ly reporting, we 
vilj. discuss the results these appl ica'iions with the 
relevant agency officials, but will not roruest formal 
agency comment on tnese briefing materials*. 

2. Our second priority assignmertt will bo to conduct an 
indepth review, applying the full framework to one program, 
the Child Welfare Services grant'. After identifying the 
program's substantive issues as described above, we will 
critique and synthesize available evaluation, prograTi and 
statistical informacion to develop an assessment of the 
program on each criterion, as feasible. 

The results of this indepth application will be reported in 
a final briefing report in November or December of 1988, 
which will also address more fully the developmvent and 
previous applications of the evaluation framework. Per 
usL*al GAO procedures, we will request formal agency comment 
on this report. 

). The wo 'k on methods for cross- progra.n comparisons will 
not be pursued. 



We will Kf >p your committee staf f informed about our 
progress on the study. If you have ar<y questions please 
contact me at 275-1370 or David Cotijray ct 275-1564. 
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Our Evaluation Framework 



Development ranking minority member of the House Select Committee on Chil- 

dren, Youth, and Families expressed concern about the wide diversity of 
criteria that have been used to review the effectiveness and efficiency 
of the programs of interest to the committee. He asked us to develop a 
general framework of evaluation criteria that could be used to compre- 
hensively and fairly assess t>.e relative merits of federal programr con- 
cerned with children, youths, and families and components of such 
programs. 

In a previous report. Children's Prog: ams: A Comparative Ev aluation 
■Framework and Five Illustration s, we presented the framework that we 
developed, and we illustrated its u.se with five fede'-al programs serving 
children and families (gao, 1988). The framework is intended as a way 
of formulating questions about a program and organizing evidence on It. 
These questions could address decisions about whether to terminate, 
reduce, expand, or modify an existing program or to initi-"e a new one. 
We developed the framework from a iew of literature on program 
evaluation methods and their use, review of the criteria used to evaluate 
specific federal programs, and the judgments of external methodologists 
and program experts. 

To illustrate the use of the framework and conduct an initial assessment 
of the range ot s utility, we prepared brief program descriptions and 
lists of indicatoi-s of the evaluation criteria for five specific federal pro- 
grams: Head Start; the Special Supplemental Food Program for Women, 
Infants, and Children; the extension of Medicaid eligibility to children ' 
and pregnant women; Child Welfare Services; and the Juvenile Justice 
and Delinquency Prev^ -on grants. We found the framework to be flexi- 
ble enough to apply to i..ese quite different program areas, to entire pro- 
grams as well as program components, and to the varied program 
activities of different governmental units. Perhaps most important, most 
of the outside experts on these programs who were asked to comment on 
the comprehensiveness of t)ie framework and illustrations thought the 
framework encomptissed tl' • main issues of their program. 
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The Evaluation 
Framework 



The framework has two components: a description of the program and a 
set of 10 general evaluation criteria. 



Program Description 



The descriptive component provides the background for the evaluative 
component. We developed a standard format that identifies the author- 
izing legislation; the problem the program is intended to address; the 
program's purpose and goals; the program's operations, including eligi- 
bility requirements, if relevant; the administrative structure; the pro- 
gram's relationships with other programs; and recent funding and 
participation levels for the program. The purpose of the program and 
the problem ic is intended to address are both derived from the authoriz- 
ing legislation and related legislative history. The word "problem" 
refers to the precipitating reasons for authorizing the program and 
could include a potential condition to be prevented. 



The evaluative component of the framework is expressed as 10 general 
criteria in a three-part structure that represents (1) the need for the pro- 
gram, (2) its implementation, and (3) its effects. This structure reflects 
our belief that an adequate assessment of a given program must con- 
sider its purpose, the nature of the problem it was designed to address, 
the context in which the program operate and its success in addressing, 
that problem. We developed the 10 criteria to categorize the types of 
issues raised about certain federal programs. We make no ^laim that this 
represents the only categorization scheme possible or that these criteria 
incorporate all the issues that could be raised about all federal 
programs. 

Need for the Program By problem magnitud e we mean the current size, intensity, and geo- 

graphic distribution of the actual or anticipated problem that this pro- 
gram (or proposed program) is designed to address. Problem magnitude 
also includes recent trends and future projerlions regarding the extent 
of the problem. It may also involve concentration of the problem by age, 
socioeconomic status, or urban or rural location. 

Pr oblem seriousness refers to what social, economic, and human conse- 
quences are anticipated if the problem is not addressed. It can be 
defined as the extent to which the problem is perceived as a threat to 
the welfare of society. Problem seriousness generally examines the 
anticipated effects of not providing services. Where the "problem" 



Ten General Evaluation 
Criteria 
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Implementation of the Program 



Effect^ of the Program 



defined m the legislation is a condition that is not in itself a problem (for 
example, lack of health insurance is the basis for extending Medicaid 
eligibility to certain groups), this criterion refers to the strength of the 
link between that condition and more serious conditions (such as not 
receiving needed health care). 

Duplication is defined as whether other public or private resources are 
sufficient to adequately address this problem. The extent of duplication 
between these efforts and the program under study would be assessed 
by examming the actual availability of other public or private programs 
services, or strategies that address this problem at the federal, state, ' 
and local levels and the adequacy of these resources. 

Interrelationships addresses the extent to which this program relies on 
(or IS relied upon by) another program, institution, or facility; how well 
they mterrelate (including the success of any required coordination); 
and how changes in one program might affect the other. Interrelation- 
ships refers to relationships between not only programs but al'>y the 
components of a single program. 

Program fidelity is defined as whether the program has been imple- 
mented at all levels of government ds currently intended by the Con- 
gress and responsible federal agency; whether the program as 
miplemented conforms to the intended program model; and the nature 
and causes of the deviations, if any, from the legislativr ^ent and 
implementing regulations. 

Administrative efficiency refers to the extent to which program 
resources are efficiently managed or spent. This includes assessing man- 
agement performance, standards and controls, and accountability for 
and ability to control program costs, as well as quality control. 

Targeting success assesses whether the program is effectivelv reaching 
Its intended recipients, whether it is appropriately focused on tiie prob- 
lem addressed, and whether its resources are effectively distribute 
among prioritized groups and across areas of the country. 

Achievement of intended objectives is defined as the program's effec- 
tiveness in reaching its intended or stated objectives. Assess'^ng a pro- 
gram on this criterion includes determining whether each component of 
the program is effective and whether some populations benefit more, or 
some objectives are met more effectively, than others. 
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G( aerall'y, program-specific objectives are found by returning to the 
problem, purpose, and goals (short-term and long-term) for the program. 
Some long-term goals may be more appropriately included under the 
"other effects'' criterion because either (1) the program is known to be 
only one of several important influences on that problem or (2) several 
intermediate steps or links are posited betwtien tho immediate go?K of 
that program and those long-term goals. 

Cost-effectiveness refers to an assessment of the e 7c of a program 
relative to the costs (for example, resources'or in^ redients) associated 
with producing those effects. In contrast to cost-benefit analysis, cost- 
effectiveness analysis measures program effects in units other than dol- 
lars and is useful in comparing programs in which the effects, such as 
reduced infant mortality, are difficult to measure in dollar terms. Cost- 
effectiveness comparisons can be made of alternative strategies for 
achieving the same goals or objectives. 

Other effects deals with how the program influences other congressional 
interests that are not explicitly stated intentions of the program. These 
include unforeseen effects— desirable or not — on the problem at hand 
or other social problems, goals, or objectives. This is where congres- 
sional committees and executive agencies can learn whether the pro- 
gram is having an effect on the long-term goals posed in the legislative 
intent or on general societal goals, such as the equitable treatment of 
individuals. Some effects might be positive, others negative. 
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Requirements of Sections 427 and 475 and 
KHS's Compliance Review Components 



Requirement 



Oescription. 



Inventory, sec. 427(1) 



Review component 



Includes all cMldren in foster care under state responsibility Administrative reviev^ 
for 6 months preceding the inventory 

State determines appropriateness of and necessity for ~ 
current foster placement, 



Statewide information system, 
sec. 427(2)(A) 



yvhether a child can or shoulJ be returned to parents or be 
freed for jadoption, 

services necessary to facilitate either the return of a childoT 
the child's placemsfit for adoption or legal guardianship 



Includes s atus demographic characteristics, location, and Administrative review 
placement goals of foster children in care the preceding 12 
months ^ ^ 



Service program, sec 

427(2)(C) 



Case plan. sec. 475(1) 
(required under sec. 427(2)(B)) 



To help children, where appropriate, return to families or be 
placed for adoption or leQ ->l guardianship 

A written ^ ^cument that includes 



Administrative review 



Case reviews, sec. 475(5)(E^) 



a plan to achieve placement in the least restrictive (most Protection 3 
family-like) setting available; uic^uuno 

a plan for placement in close proximity to the parents' ProtectionT 
home, consistent with the best ir.terest and special needs 
of the child (sec. 475(5)(A); 

a description of type of home or institution in which a child ProtectionT 
IS to be place d; 

a discussion of appropriateness of placement; Protection 2 

■c statement of hovv the responsible e^^ency plans to carry Protection 5 

out the voluntary placement agree;7ient or judicial 

d etermination made In accordance wi th sec. 472(s)(1); 

a plan for ensuring that the child will receive proper ca re; Protection 6 

a plan for providing services to the parents, child, and foster Protection 7 

parents to improve conditions in the parents' home and 

facilitate the return of \ne child home or permanent 

placement; 

a plan for services to address t^.e needs of a child while in Protection 8 
foster care; 



Major requirement of case record review 



a discussion of appropriateness of services provided; Protection 9 



where appropriate, for a child 16 or over, a description of 
programs and servr,es to prepare for transition to 
independent living 



Not part of 427 review 



Status of each child is revewed periodically but no less 
frequej.ily than'once eveiy 6 months by a court or 
administrative review t o determine 

continuing necessity for and appropriatenes s of placement. "Protection 10 

extent of compliance with case plan. Protection 1 1 

extent of progress made toward alleviating or "miiliqatinq" 
causes of foster placement, 

likely date child may be returned home oT placed for 
_jdoption or provided legal guardianship 



Major requirement of case record review 



Protection 12 



Protection 13 



(continued) 
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Requirement 


Description 


Review component 


Sec. 475(6) 


Administrative review means 




open to participation of the parents, 


Protection 14 




conducted by panel of appropriate persons, at least one of 
whom is not responsible for the case management of, or the 
delivery of services to, the c^^ild or parents 


Protection 15 


Dispositional hearing. S6C 
475(5)(C) 


i U UC i ICIU 

in family or juvenile court or other court of competent 
jurisdiction or by administrative body apprv ved by the 
court. 


Major requirement of case record review 




no later than 18 months a'ter the original placement (and 
periodically thereafter during care). 


Major requirement of case record review 




to determine future status of the child (return to parent, 
continue foster care for specified period on pern.ansnt or 
long-term basis, placement for adoption), 

to determine transition services needed for a child 16 or 
older (added, affective October 1. 1988) 


Major requirement of case record review 
Not part of 427 review 


Pr^ cedural safeguards, sec 
475(5)(C) 


Applied to 

parental rights pertaining to removal of child from parent's 
home. 


Protection 16 




a change in child s placement, 

any determination of parents* visitation privileges 


Protection 17 
Protection 18 
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Outcome of ACYF 
Compliance With Section 427 




New Hamps hire 
New Jersey 



New Mexico 
New York 
No rth Carolina 
North Dakota ~" 



Ohio 



Oklahoma 

Or egon 

Pennsylvania 



Fal|c 



Pass 



Pass 



Fail 



Pass 



NA 



Pass 



Pass 



Pass 



Pass 



Pass 



Pass 



NA 



Pasj5 



Pass 



Pass 



Pass 



Pass 



FaiF 



Pass 



Fail 



Pass 



Pass 



Pass 
Pass 



NA 



NA 



Fair 



Pass 



Fail 



Pass 



Pass 



Pass 



■"ass 
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State* 


1981 


1982 


1983 


1984 


1985 


1986 1987 


Rhodo Island . 


Fail 


Pass 


Fail 


Pass 




Pass 


South Carolina 


Pass 


Pass 






Pass 




South Dakota 


Pass 


'^3SS 






Pass 




Tennessee 


Pass 


Kass 






Pass 




Texas 


NA 


Pass 


Pass 






Pass 


Utah 


Pass 


Pass 






Pass 




Vermont 


Fail^ 


Pass 


Fail^ 


Pending^ 






Virginia 


Pass 


Fail^ 


FaiF 


Pass 






'^Jshington 


Pass 


Pass 






Pass 




West Virginia 


Pass 


Pass 






Fail 


Pending^ 


Wisconsin 


NA 


Pass 


Pass 






Pass 


Wyoming 


Pass 


FaiP 


Fail 


NA 


NA 


NA NA 



^Table is for fiscal years, excluding the territories. Blanks Indicate that the state was not reviewed that 
year, i-iowever, ACYF considers a state eligible for incentive funds between reviews, as long as it certi- 
fies compliance with the law. NA means that the state did not certify compliance and apply for funds or 
"^ter withdrew its certification. 



°A case-record review was conducted, but the compliance decision has not been reached. 
^This reflecti. the final decision of the HHS departmental appeals board on the state's appeal. 
^State's appeal is pending in U.S. District court. 
^State withd/ew its appeal of ACYF's decision. 
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Experts C!onsuited 



To identify work in progress and elicit nominations of the most impor- 
tant research, we contacted several exp-'rts in the area. They were 
David Fanshel, Columbia University S ool of Social Work; Peter For- 
sythe, Program for Children, Edna M. mell Clark Foundation; Char'es 
Gershenson, Center for the Study of Social Policy; Mark Hardin 
National Legal Resource Center for Child Welfare, American Bar A^^soci- 
ation; Helame Hornby, National Child Welfare Resource Center for Man- 
agement and Administration; Christina Klotz, Anne Casev Foundation- 
Jerry Lmdskog, Minnesota Department of Hum^.. Services; Marcia 
Lowry, American Civil Liberties Union; Joyce Munns, Child Welfare 
League; Patricia Schene, American Association for Protecting Children- 
Shelley Smith, National Conference of State Legislatures; Toshio Tatara, 
American Public Welfare Association; Rachel Warren, University of 
Iowa School of Social Work; Ying-Ying Yuan, Walter R. McDonald and 
Associates. 



In addition, an earlier draft of this report was reviewed by Charles Ger- 
shenson, Center for the Study of Social Policy; MarK Hardin, National 
Legal Resource Center for Child Welfare, American Bar Association; 
William Pierce, National Committee for Adoption; and Toshio Tatara 
American Public Welfare Association. ' 




ERIC 



Page 80 



G\0/VKMm<h\7 IinplcMucMiiation niuX Effects of Poster Care Refoniis 



Appendix VII 



Comments From the Department of Health and 
Human Services 




DEPARTMENTOF IIEAITH HUMAN SERVICES 



Otfico ui inspcctOf General 



mrtinQlon, DC 20201 



MS. Eleanor CheliiPsKy 
Assistant Comptcollec Genecsi 
United States Geneiral 

Accounting Office 
Washington/ D.C. 20548 

Dear nO^-elW^ftnsky: 

Enclosed ace the Depactrcnt's comments on youc dca't cepoct/ 
"Foster Cace: Incomplete Implementation of Reform, and Unknown 
Effectiveness." Thw enclosed comments represent the tentative 
position of the Department and are subject to reevaluation when 
the final version of this report is received. 

'I'ho Depa. "»ient appreciates the opportunity to comment on this 
craft report before its publication. 



Sincerely your?/ 




R chard P. Kusserow 
Inspector General 



Enclosure 
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. COMMENTS OF THE nKPflRTMENT OF HKAT.TH am Q HUMAN SFPWrp g n» 
THE US. GENERA L ACC C t~N TING OFFirE 'S REPORT, " rn-rp vl ot.. 

INCr -PL ETE IMPIEMENT/.TION OF REFORMS AND IIMfn^O WN '~ 

EFFECTiV F:NESS" fGAO CODE 97:i6Trp 



General CnmniPnt-c 

This report was developed by the General Accounting Office (GAOi 
using a general framework of evaluation criteria which had beeS 
Sith'cM-^ developed to fairly assess Federal proSS concerned 

^ ^"^ families. We feel tnat this methodology 

allowed GAO to approach the subject of the Section ^37^°^^ 
protections and the implementation of the program from an 
?^^ncf^''^ perspective. The office of Human Development Services 
^OHDS)^ appreciates the objectivity and thoroughness of thi 

In several places, the report indica .-s that some of the noted 
improvements m the State child welfare systems had been 
initjated prior to the passage of Public Law 96-272 and, 
therefore could not be attributed to the effects of that law. 
The legislation that ultimately was enacted as Public Law 96-272 
had been introduced in the Congress several times tnd had 
actually passed both Houses of Congress in the previous session 
Accordingly, the states and child welfare practitioners were 
aware of the content and even the details of the proposed 
l™ntp™^nJ^?^^^''^v^iKy^^P.*'^^°''^ passage and had begun 

^^^^^ ^"^ level in the expactation of 

Its eventual passage. Therefore, we believe that it is 

attr^h.l^iKi^^^^fK"'^ °f the pre-1980 improvements are 

pSuc SS 16-272 anticipation of the enactment or passage of 

In addition, we have some substantive comments related to 
specific statements and recommendations made in the draft L-eoort 
tSelinll^ep^tf '^'^ consideration f^pre^a^ing 

the report?"*"' ^^""^^ ^^"""^ ^""^ ^" "eferences throughout 

"because acVF does not require States to provide alJ 18 
protections m order to receive incentive funds, there is little 
incentive for the states that have met ACVF's highest compliance 
standard to fully comply with the .law." compliance 

Department Comment. 

The first part of the statement is incorrect in that the 
States are required to provide all of the protections in the 
statute in order to receive additional (in'ientive) Title Iv-B 
funds. In the administrative procedures review conducte-l by the 
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Now on page 28. 



Now on page 31. 



.<iegional Offices at the time of the initial review, all Section 
427 requirements Tiust be documented in State law, regulations or 
policies and, if they are not, the review does not proceed to the 
case record survey. The review procedure which allows an 
individual case to pass if only 15 of the 18 protections are met 
is applied as a tolerance level only; we do not believe it affects 
a State's efforts to meet all of the protections for each child, 

GAO Statement: page 3-13 

"The paucity of information about reunification services • . . can 
be attributed in part to the fact that these services have not 
been described in ACYF compliance review guidelines, are only 
vaguely defined in practice, and have a myriad of designations. . 
. . In addition, reunification services are frequently lumped 
together in the literature with prevention placement services and 
not studied separately." 

Department Comment 

The quoted statements are accurate. We believe that many States 
provide some of the same services to achieve the separate goals of 
prevention and reunification.- They do not always distinguish the 
services by the reason they are provided. 

T! e focus on preventive services may result from the requirement 
tha'*, prior to removing a child from the home. States must get a 
ju^Ucial determination that reasonable efforts were made to 
prevent the breakup of the family. If States do not get this 
determination, the child is not eligible for Title IV-E funds. 

The office of Human Development Services, Administration for 
Children, Youth and Frmilies, is currently examining ways to 
strengthen the review of all requirements in the statute " 
expect to closely folic:' the issue of reunif ication. 

GAO Statement; pace 3-18 

II ... in its section 427 compliance reviews, ACYF does not 
attempt to judge how effective the periodic case review has been 
for ensurj.ng the child's appropriate care and placement, or how 
competent the review body was in making its own dc^tGrmination." 

Department Comment 

The statement is true. The law, however, only requires the States 
to provide the protections in order to be eligible for the 
incentive funds. It does not specify a required quality for the 
periodic case reviews or i idicate how effective they must b^. Tne 
law does not allow the Depa).tment to assess penalties based on the 
lack of quality or effectiveness of the required protections. 



We 
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Now on, page 41. 



Now on page 66. 



GAP statement; page A«><^ 

than^fn'^Ji?; M^I" «ere placed in institutions in 1985 

than m 1977 (10 percent versus 14 percent). ..." 

Depart ment Corampnt 

This statement understates a rather dramatic change that has 
n^^h^'r^S/"*,-?^ foster care program, .^oth in terSs of ?Je absolute 

'Children in institutions as well as the percentage of 
children in institutions between 1977 and 1S85. The nuSber of 

of cSillJl; «iSnfH percent in the absolute number 

Of children placed in institutions. Even relatively, it is a 
decrease of over 28 percent. ^v^xy, it is a 

SAP Recommendatie n; oaae 6-3 

"GAO recoumends that the Secretary reexamine the Department's 
standards for certifying states' compliance with the section 427 
requirements to ensure that receipt of incen?Iv2 SSdS S 
contingent, from 1989 onward, on states meeting all or the law's 
requirements In particular, we recommend requiring states t? 
implement all ths required elements of the ca^e re"lcl syltem!" 

Department g^T^lfynt 

We concur with thxs recommendation with some reservations. The 
Of Human Development Services is not opposed to ^h^ngiSg 
^Cfr^ documentation in the case re?o?d of 

"°««ver, we believe that some 
fi^i^i^'*^?" °^the items included in the case record survey 
instrument IS called for so that state agency staff and reviewers 
know exactly what is meant by each procection. reviewers 

The Children's Bureau of the Administration foi Children, youth 
n^^/r^^-r '^"^""tly examining the entire Section 427 revi^-w 
procedure in nn effort to capture a better sense of the oualitj 
and outcomes of casework services and case review procLS. ^ 
Through a planned restructuring of the Section 427 review 
proceaures, the Department hopes to be', able to determine the 
adequacy of the protections and services provided. 
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and Human Services 



Page 4 



Now on page 66. 



Withdrav^n. 



Now on page 33. 



GAP Recommendation: page 6-3 

••GAO further recommends that the Secretary promptly comply with 
tlie legislative mandates of Public Law 99-509 regarding the 
development of an adoption and foster care information system." 

De partment Conment 

We concur. The Department has developed the required report to 
the Congress and has also developed a draft Notice of Proposed 
RuIamaKing which would implement the substance of the report. 
Final negotiations end clearances, how^^ver, still must be 
completed prior to their release. 

pecommendation for Cor sideration bv Conqregg: PMg 

. .the Congress may want to amend tha law to -pecif ic-illy 
authorize states tc^ distribute a portion of these ;^unds tc thii 
state court systems, as an incentive f o** the courts to lulfill the 
case review requirements." 

Departm ent CoinT.^ent 

We do not concur. This recommendation is based upon opinions in 
the literature that the family c-^^urt is overburdened and the 
belief that the Federal government has 'contributed to the problem 
of inadefj[uate judicial resources "because the federal requirements 
make substantial demands upon the courts." (Page 3-22) 

While it is true that Titles- IV-E and IV-3 require certain 
judicial detei> -*naJ:ions by the court at the timp of removal of a 
child from his home and at a dispositional hearing within 18 
months after placement, these critical p -'ints of court 
participation are traditional in the chi^d welfare/court system 
and should not be considered additional demands upon the court. 
The requirement for a judicial determination witb5n ICO days of a 
voluntary placement could be considered a new requirement of 
Federal law, but the number of such cases is not high. 

There is no specific requirement in the statute for the court to 
conduct periodic (six month) reviews of the child's status in 
foster care. Such reviews have tracitionally been conducted by 
the child welfare agency with the famil/ in order to u">date the 
case plan and to detennine next steps for the retvrn oj! tht chxld 
to his/her family. The requirement in Section 475 for an 
objective party to participate in the administrative review is an 
assurance to the child and family of input outside the line of 
authority in the foster care case. 
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We believe that, if the reforms intended in Public Law 96-777 
o investigate child abuse and neglect 

° ?":1hefr"SHS """"^ -P".tl™ Of childr.n 
the'iality Sf s^lv!lM^r"lSd'. '""""^ training to i.prove 



Technical Ccamt^ntg 



autnorizea m 1935, but it did not become Title iv-^ until 1967! 
Page 2-3, second sentence under paragraph headed Th*. tv-r 
JS-B'^a^'h" ^r'^' "^""^^^ ProvidL to stat es und^r rTtlT 

assL?anc^ „"^f ^°^^f^ '^^'^^ maintenance or adoption 
on?J%'^"a"lL^?e^ e=^t%\t"^^'^^ °^ ^ P-ent, but 
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Page 6 



Now^'^ page 17. 
Now on page 19. 

Withdrawn. 



Pages 2-3 and 2-4: the sentence should have the phrase "up to the 
amount of their allotment" added after "... local program costs." 

Page 2-8, third sentence: The sentence should more accurately 
read, "State eligibility for funds for Title IV-E voluntary foster 
care is linked to implementation of the Section 427 refoims and, 
und^r certain circumstances, the availability of preventive 
preplacemcnt services." 

Page 6-2, middle paragraph, second sentence, this sentence should 
make clear that in many instances the courts themselves have 
eleczted to conduct th* periodic reviews. 



So 
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